Free NCA-GENL sample questions

Correct answer: In-flight Batching

In-flight batching (also known as continuous batching) is the correct feature. Unlike dynamic batching, which waits to form a complete batch before processing, in-flight batching can add new requests to a batch that is already being processed. This allows shorter requests to be processed and return while longer ones are still running, effectively eliminating head-of-line blocking and improving overall throughput and latency.

Correct answers: NVIDIA NeMo Guardrails; Retrieval-Augmented Generation (RAG) on internal patient data

NeMo Guardrails is specifically designed to control the topics an LLM can discuss, prevent it from executing unsafe actions, and ensure it stays within predefined conversational boundaries. This directly addresses the need to prevent off-topic conversations.

Using a RAG architecture that only pulls from the hospital's internal, secure patient database ensures that the LLM's responses are grounded in factual, relevant data and do not hallucinate or access external information. This enhances both accuracy and privacy.

Correct answer: False

The statement is false. LoRA is a Parameter-Efficient Fine-Tuning (PEFT) method. It works by freezing the original pre-trained model weights and injecting small, trainable rank-decomposition matrices (adapters) into the layers of the Transformer architecture. Only these new, much smaller matrices are updated during training, which drastically reduces the number of trainable parameters and computational cost.

Correct answer: Pipeline Parallelism

Pipeline Parallelism is the technique of splitting the layers of a neural network model across multiple GPUs. Each GPU processes a subset of the model's layers (a stage) in a pipeline fashion. This is used when a model is too large to fit into a single GPU's memory. Data Parallelism replicates the model on each GPU, and Tensor Parallelism splits individual layers/tensors across GPUs.

Correct answer: ROUGE

ROUGE (Recall-Oriented Understudy for Gisting Evaluation) is a set of metrics used for evaluating automatic summarization and machine translation. It works by comparing an automatically produced summary against a set of reference summaries (typically human-written) and measures the overlap of n-grams, word sequences, and word pairs.

Correct answer: NeMo Guardrails

NVIDIA NeMo Guardrails is an open-source toolkit for adding programmable, rule-based controls to LLM-based applications. It allows developers to define specific conversational paths, control topics, prevent the model from accessing certain tools, and filter out undesirable content, making it the correct choice for ensuring safe and on-topic conversations.

Correct answer: To weigh the importance of different words in the input sequence relative to each other.

The self-attention mechanism allows the model to associate each word in the input sequence with other words in the same sequence. It calculates attention scores that determine how much focus to place on other words when encoding a specific word. This allows the model to capture long-range dependencies and understand context within the sequence, which is a key advantage over recurrent architectures.

Correct answer: Output Regeneration/Plagiarism

This scenario describes output regeneration, also known as plagiarism or regurgitation. It occurs when a generative model reproduces verbatim or near-verbatim excerpts from its training data. If the training data includes copyrighted material, this can lead to copyright infringement. This is a key concern in responsible AI development.

Correct answer: Weight-only quantization (e.g., INT4, INT8)

Weight-only quantization is a technique used to represent a model's weights using lower-precision integers (like INT8 or INT4) instead of floating-point numbers (like FP16). This significantly reduces the model's memory footprint and can accelerate inference, especially on GPUs with specialized hardware for integer arithmetic. TensorRT-LLM provides robust support for these quantization methods.

Correct answer: Chain-of-thought (CoT) prompting

Chain-of-thought (CoT) prompting is a technique that encourages the LLM to break down a complex problem into intermediate reasoning steps before providing a final answer. The phrase 'Think step by step' is a classic way to elicit this behavior, often leading to more accurate and logical results, especially for arithmetic, commonsense, and symbolic reasoning tasks.