Microsoft Operationalizing Machine Learning and Generative AI Solutions Sample Questions:

1. You are fine-tuning a base language model to analyze customer feedback.
You label examples of support tickets. You must improve classification accuracy by configuring and fine-tuning the base model in Microsoft Foundry.
You need to configure and run fine-tuning.
What should you do first?

A) Deploy the base model to an online endpoint before starting fine-tuning.
B) Format the dataset as a JSONL file with prompt-completion pairs and upload the file.
C) Use prompt flow to generate multiple prompt templates for evaluation.
D) Enable tracing for all inference calls in the evaluation pipeline.

2. A Retrieval-Augmented Generation (RAG) solution returns incomplete answers because relevant content is inconsistently retrieved from the knowledge source.
You need to improve RAG accuracy without changing the embedding model currently in use. You need to achieve this goal while minimizing operational costs.
Which two actions should you perform? Each correct answer presents part of the solution.
Choose two.
NOTE: Each correct selection is worth one point.

A) Implement an optimized re-ranker.
B) Optimize the length of embedding vectors.
C) Increase token limits for all requests.
D) Tune chunk size and overlap to match content structure.

3. Hotspot Question
A machine learning model is deployed to production in Azure Machine Learning and is actively serving predictions for a business application. The model was trained by using a historical dataset that represented expected input patterns at the time of deployment.
The team working on the model must ensure the following:
- Changes in input data distribution are detected.
- Appropriate actions are triggered when predefined thresholds are
exceeded.
You need to configure monitoring to meet the requirements.
Which configuration should you use for each requirement? To answer, select the appropriate options in the answer area.
NOTE: Each correct selection is worth one point.

4. Note: This question is part of a series of questions that present the same scenario. Each question in the series contains a unique solution that might meet the stated goals. Some question sets might have more than one correct solution, while others might not have a correct solution.
After you answer a question in this section, you will NOT be able to return to it. As a result, these questions will not appear in the review screen.
You have an Azure Machine Learning workspace. You connect to a terminal session from the Notebooks page in Azure Machine Learning studio.
You plan to add a new Jupyter kernel that will be accessible from the same terminal session.
You need to perform the task that must be completed before you can add the new kernel.
Solution: Delete the Python 3.6 - AzureML kernel.
Does the solution meet the goal?

A) No
B) Yes

5. During training, pipelines occasionally fail due to schema mismatch caused by upstream data changes. You need a robust and automated solution that prevents invalid data from reaching training steps. What is the BEST approach?

A) Use larger compute
B) Retrain manually when failure occurs
C) Ignore schema differences
D) Add a data validation component in pipeline

Solutions: