CASE STUDY
Please use the following to answer the next question:
A small local flower delivery company operates a few stores and has a limited IT budget. To reduce the time spent on customer service, which is a major drain on employee time, the company plans to implement a simple but high-performance generative AI chatbot on its website. The chatbot will provide real-time, fact-based responses to customer inquiries and assist with order processing, helping to reduce incoming phone calls.
The company currently uses a single on-premises server for its order database and email system and has not yet partnered with a cloud provider.
An internal data privacy policy governs the use of customer data. This policy, written before the adoption of AI, allows the use or transfer of customer data beyond name and contact information but requires that all such data be deleted after the order is completed. The company prefers to maintain this policy without changes.
MULTI-SELECT
Please select 3 of the 5 options below. No partial credit will be given.
Which of the following actions would necessitate a change to the company ' s privacy policy?
A UK company has designed a facial recognition model to support border control.
The EU AI Act would apply to the model in all of the following situations EXCEPT if?
What is the 1956 Dartmouth summer research project on Al best known as?
A US hospital plans to develop an AI that will review available patient data in order to propose an initial diagnosis to licensed physicians. The hospital will implement a policy that requires physicians to consider the AI proposal, but conduct their own physical examinations prior to making a final diagnosis.
An important ethical concern with this plan is?
A company plans on procuring a tool from an Al provider for its employees to use for certain business purposes.
Which contractual provision would best protect the company ' s intellectual property in the tool, including training and testing data?
Who is responsible for ongoing maintenance and monitoring of an AI system after it has been put into production?
Random forest algorithms are in what type of machine learning model?
According to the Singapore Model Al Governance Framework, all of the following are recommended measures to promote the responsible use of Al EXCEPT?
A company developing and deploying its own AI model would perform all of the following steps to monitor and evaluate the model ' s performance EXCEPT?
Scenario:
A financial services company is planning a new AI project to assess creditworthiness. The AI team is mapping out what tasks should be completed during theplanning phaseof the AI lifecycle.
The planning phase of the AI lifecycle includes all of the following EXCEPT:
Machine learning is best described as a type of algorithm by which?
All of the following may be permissible uses of an Al system under the EU Al Act EXCEPT?
An AI start-up is developing a system for automated loan approvals. The team wants to minimize risks of bias and regulatory non-compliance. They have already identified potential stakeholders, including regulators and consumer groups.
What is the most appropriate sequence of next steps?
Which of the following best defines an " Al model " ?
CASE STUDY
A global marketing agency is adapting a large language model ( " LLM " ) to generate content for an upcoming marketing campaign for a client ' s new product: a hard hat designed for construction workers of any gender to better protect them from head injuries.
The marketing agency is accessing the LLM through an application programming interface ( " API " )developed by a third-party technology company. They want to generate text to be used for targeted advertising communications that highlight the benefits of the hard hat to potential purchasers. Both the marketing agency and the technology company have taken reasonable steps to address Al governance.
The marketing company has:
• Entered into a contract with the technology company with suitable representations and warranties.
• Completed an impact assessment on the LLM for this intended use.
• Built technical guidance on how to measure and mitigate bias in the LLM.
• Enabled technical aspects of transparency, explainability, robustness and privacy.
• Followed applicable regulatory requirements.
• Created specific legal statements and disclosures regarding the use of the Al on its client ' s advertising.
The technology company has:
• Provided guidance and resources to developers to address environmental concerns.
• Build technical guidance on how to measure and mitigate bias in the LLM.
• Provided tools and resources to measure bias specific to the LLM.
• Enabled technical aspects of transparency, explainability, robustness and privacy.
• Mapped and mitigated potential societal harms and large-scale impacts.
• Followed applicable regulatory requirements and industry standards.
• Created specific legal statements and disclosures regarding the LLM. including with respect to IP and rights to data.
The agency has taken governance actions such as:
Conducting an impact assessment
Providing legal disclosures
Enabling bias mitigation and explainability
Complying with regulatory requirements
Which of the following should be included in the marketing company’s disclosures about the use of the LLM EXCEPT?
Which stakeholder is responsible for lawful collection of data for the training of the foundational AI model?
CASE STUDY
Please use the following answer the next question:
A mid-size US healthcare network has decided to develop an Al solution to detect a type of cancer that is most likely arise in adults. Specifically, the healthcare network intends to create a recognition algorithm that will perform an initial review of all imaging and then route records a radiologist for secondary review pursuant Agreed-upon criteria (e.g., a confidence score below a threshold).
To date, the healthcare network has taken the following steps: defined its Al ethical principles: conducted discovery to identify the intended uses and success criteria for the system: established an Al governance committee; assembled a broad, crossfunctional team with clear roles and responsibilities; and created policies and procedures to document standards, workflows, timelines and risk thresholds during the project.
The healthcare network intends to retain a cloud provider to host the solution and a consulting firm to help develop the algorithm using the healthcare network ' s existing data and de-identified data that is licensed from a large US clinical research partner.
The most significant risk from combining the healthcare network’s existing data with the clinical research partner data is?
CASE STUDY
Please use the following answer the next question:
A local police department in the United States procured an Al system to monitor and analyze social media feeds, online marketplaces and other sources of public information to detect evidence of illegal activities (e.g., sale of drugs or stolen goods). The Al system works by surveilling the public sites in order to identify individuals that are likely to have committed a crime. It cross-references the individuals against data maintained by law enforcement and then assigns a percentage score of the likelihood of criminal activity based on certain factors like previous criminal history, location, time, race and gender.
The police department retained a third-party consultant assist in the procurement process, specifically to evaluate two finalists. Each of the vendors provided information about their system ' s accuracy rates, the diversity of their training data and how their system works. The consultant determined that the first vendor’s system has a higher accuracy rate and based on this information, recommended this vendor to the police department.
The police department chose the first vendor and implemented its Al system. As part of the implementation, the department and consultant created a usage policy for the system, which includes training police officers on how the system works and how to incorporate it into their investigation process.
The police department has now been using the Al system for a year. An internal review has found that every time the system scored a likelihood of criminal activity at or above 90%, the police investigation subsequently confirmed that the individual had, in fact, committed a crime. Based on these results, the police department wants to forego investigations for cases where the Al system gives a score of at least 90% and proceed directly with an arrest.
The best human oversight mechanism for the police department to implement is that a police officer should?
MULTI-SELECT
Please select 3 of the 5 options below. No partial credit will be given.
What are the roles and responsibilities of deployers of a proprietary model?
Why is it important that conformity requirements are satisfied before an AI system is released into production?
During the first month when the company monitors the model for bias, it is most important to?
Retrieval-Augmented Generation (RAG) is defined as?
CASE STUDY
Please use the following answer the next question:
XYZ Corp., a premier payroll services company that employs thousands of people globally, is embarking on a new hiring campaign and wants to implement policies and procedures to identify and retain the best talent. The new talent will help the company ' s product team expand its payroll offerings to companies in the healthcare and transportation sectors, including in Asia.
It has become time consuming and expensive for HR to review all resumes, and they are concerned that human reviewers might be susceptible to bias.
Address these concerns, the company is considering using a third-party Al tool to screen resumes and assist with hiring. They have been talking to several vendors about possibly obtaining a third-party Al-enabled hiring solution, as long as it would achieve its goals and comply with all applicable laws.
The organization has a large procurement team that is responsible for the contracting of technology solutions. One of the procurement team ' s goals is to reduce costs, and it often prefers lower-cost solutions. Others within the company are responsible for integrating and deploying technology solutions into the organization ' s operations in a responsible, cost-effective manner.
The organization is aware of the risks presented by Al hiring tools and wants to mitigate them. It also questions how best to organize and train its existing personnel to use the Al hiring tool responsibly. Their concerns are heightened by the fact that relevant laws vary across jurisdictions and continue to change.
Which other stakeholder groups should be involved in the selection and implementation of the Al hiring tool?
Which of the following is an example of a high-risk application under the EU Al Act?
According to November 2023 White House Executive Order, which of the following best describes the guidance given to governmental agencies on the use of generative Al as a workplace tool?
Scenario:
An enterprise is evaluating multiple third-party generative AI tools to integrate into its platform. As part of its AI governance policy, it is assessing themost effective methodsto reduce risks related to bias, data misuse, and liability when using third-party solutions.
All of the following are commonly adopted processes and policies in reducing potential risks introduced by third-party AI tools or applications EXCEPT:
MULTI-SELECT
Please select 3 of the 5 options below. No partial credit will be given.
From a governance perspective, which of the following correctly describe the responsibilities of AI developers or deployers?
MULTI-SELECT
Please select 3 of the 5 options below. No partial credit will be given.
In cooperation with an Italian University, a US technology company called Nudge 2078, with no offices or employees in other countries, is developing an AI system which subtly encourages " good " behaviors, such as saving money and exercising. The two companies plan to conduct some experiments on volunteers. However, the study protocol is misleading on the purpose of the study, the experiments that will be conducted and its relevance to the application.
Which regulations are most likely applicable?
To assist its internal recruiters with filtering job applications, a company decides to develop in-house an AI model for screening and ranking job applicants ' resumes.
Which of the following is a unique issue this company might face compared with using a third-party AI service?
According to the GDPR, what is an effective control to prevent a determination based solely on automated decision-making?
A company developed Al technology that can analyze text, video, images and sound to tag content, including the names of animals, humans and objects.
What type of Al is this technology classified as?
The best method to ensure a comprehensive identification of risks for a new AI model is?
In procuring an AI system from a vendor, which of the following would be important to include in a contract to enable proper oversight and auditing of the system?
Which of the following is NOT a common type of machine learning?
When should an ethical impact assessment for AI be performed?
Under the NIST Al Risk Management Framework, all of the following are defined as characteristics of trustworthy Al EXCEPT?
What is a key opportunity for companies deploying proprietary Agentic AI models?
Why is it important that conformity requirements are satisfied before an AI system is released into production?
What is the primary purpose of an Al impact assessment?
CASE STUDY
A premier payroll services company that employs thousands of people globally, is embarking on a new hiring campaign and wants to implement policies and procedures to identify and retain the best talent. The new talent will help the company ' s product team expand its payroll offerings to companies in the healthcare and transportation sectors, including in Asia.
It has become time consuming and expensive for HR to review all resumes, and they are concerned that human reviewers might be susceptible to bias.
To address these concerns, the company is considering using a third-party Al tool to screen resumes and assist with hiring. They have been talking to several vendors about possibly obtaining a third-party Al-enabled hiring solution, as long as it would achieve its goals and comply with all applicable laws.
The organization has a large procurement team that is responsible for the contracting of technology solutions. One of the procurement team ' s goals is to reduce costs, and it often prefers lower-cost solutions. Others within the company deploy technology solutions into the organization’s operations in a responsible, cost-effective manner.
The organization is aware of the risks presented by Al hiring tools and wants to mitigate them. It also questions how best to organize and train its existing personnel to use the Al hiring tool responsibly. Their concerns are heightened by the fact that relevant laws vary across jurisdictions and continue to change.
The organization continues planning the adoption of an AI tool to support hiring, but is concerned about potential bias in content generated by AI systems and how that could affect public perception.
Which of the following measures should the company adopt tobest mitigate its risk of reputational harmfrom using the AI tool?
Each of the following actors are typically engaged in the Al development life cycle EXCEPT?
CASE STUDY
Please use the following answer the next question:
A mid-size US healthcare network has decided to develop an Al solution to detect a type of cancer that is most likely arise in adults. Specifically, the healthcare network intends to create a recognition algorithm that will perform an initial review of all imaging and then route records a radiologist for secondary review pursuant agreed-upon criteria (e.g., a confidence score below a threshold).
To date, the healthcare network has taken the following steps: defined its Al ethical principles: conducted discovery to identify the intended uses and success criteria for the system: established an Al governance committee; assembled a broad, crossfunctional team with clear roles and responsibilities; and created policies and procedures to document standards, workflows, timelines and risk thresholds during the project.
The healthcare network intends to retain a cloud provider to host the solution and a consulting firm to help develop the algorithm using the healthcare network ' s existing data and de-identified data that is licensed from a large US clinical research partner.
In the design phase, which of the following steps is most important in gathering the data from the clinical research partner?
Cloud-based deployment of AI often has which of the following advantages?
A company has trained an ML model primarily using synthetic data, and now intends to use live personal data to test the model.
Which of the following is NOT a best practice apply during the testing?
Which of the following use cases would be best served by a non-AI solution?
When monitoring the functional performance of a model that has been deployed into production, all of the following are concerns EXCEPT?
Under the Canadian Artificial Intelligence and Data Act, when must the Minister of Innovation, Science and Industry be notified about a high-impact Al system?
Pursuant to the White House Executive Order of November 2023, who is responsible for creating guidelines to conduct red-teaming tests of Al systems?
What is the technique to remove the effects of improperly used data from an ML system?
Which of the following may bepermissible usesof an AI system under the EU AI ActEXCEPT?
What is the most important factor when deciding whether or not to select a proprietary AI model?
Scenario:
A company using AI for resume screening understands the risks of algorithmic bias and the evolving legal requirements across jurisdictions. It wants to implement the right governance controls to prevent reputational damage from misuse of the AI hiring tool.
Which of the following measures should the company adopt to best mitigate its risk of reputational harm from using the AI tool?
Which risk management framework/guide/standard focuses on value-based engineering methodology?
The White House Executive Order from November 2023 requires companies that develop dual-use foundation models to provide reports to the federal government about all of the following EXCEPT?
Scenario:
A distributor operating in the EU is responsible for selling imported high-risk AI systems to businesses. The distributor wants to ensure they fulfill all applicable obligations under the EU AI Act.
All of the following are obligations of a distributor of high-risk AI systems under the EU AI Act EXCEPT?
All of the following are elements of establishing a global Al governance infrastructure EXCEPT?
All of the following may be copyright risks from teachers using generative AI to create course content EXCEPT?
Which of the following arenotconsidered biometric data under U.S. privacy laws?
Scenario:
Business A provides grammar and writing assistance tools and licenses a generative AI model from Business B to enhance its offerings. Business A is concerned that the AI model might produce inappropriate or toxic content and wants to implement governance processes to prevent this.
Which of the following governance processes should Business A take tobest protect its usersagainst potentially inappropriate text?
CASE STUDY
Please use the following answer the next question:
ABC Corp, is a leading insurance provider offering a range of coverage options to individuals. ABC has decided to utilize artificial intelligence to streamline and improve its customer acquisition and underwriting process, including the accuracy and efficiency of pricing policies.
ABC has engaged a cloud provider to utilize and fine-tune its pre-trained, general purpose large language model (“LLM”). In particular, ABC intends to use its historical customer data—including applications, policies, and claims—and proprietary pricing and risk strategies to provide an initial qualification assessment of potential customers, which would then be routed a human underwriter for final review.
ABC and the cloud provider have completed training and testing the LLM, performed a readiness assessment, and made the decision to deploy the LLM into production. ABC has designated an internal compliance team to monitor the model during the first month, specifically to evaluate the accuracy, fairness, and reliability of its output. After the first month in production, ABC realizes that the LLM declines a higher percentage of women ' s loan applications due primarily to women historically receiving lower salaries than men.
Which of the following is the most important reason to train the underwriters on the model prior to deployment?
What is the most important reason for documenting risks when developing an AI system?
What is the best method to apply to an AI model so that it is statistically unlikely that a specific piece of training data can be identified from a model ' s output?
Which of the following compliance related controls within an organization is most easily adapted to identify AI risks?
Scenario:
A large multinational organization is rolling out a company-wide AI governance initiative. To build awareness and support adoption, they are evaluating different ways to train employees and stakeholders across departments, including legal, technical, marketing, and customer-facing roles.
Which of the following typical approaches is a large organization least likely to use to responsibly train stakeholders on AI terminology, strategy and governance?