Weekend Sale Special - 75% Discount Offer - Ends in 0d 00h 00m 00s - Coupon code: 75only

Anthropic CCAR-F Claude Certified Architect – Foundations Exam Practice Test

Demo: 45 questions
Total 152 questions

Claude Certified Architect – Foundations Questions and Answers

Question 1

You are building a multi-agent research system using the Claude Agent SDK. A coordinator agent delegates to specialized subagents: one searches the web, one analyzes documents, one synthesizes findings, and one generates reports. The system researches topics and produces comprehensive, cited reports.

After the web-search and document-analysis subagents complete their tasks, the coordinator needs to spawn the synthesis subagent to synthesize the findings.

What is the correct approach for providing the synthesis subagent with the information it needs?

Options:

A.

Provide the subagent with tool definitions that allow it to request outputs from other subagents through callbacks.

B.

Include the complete findings from both subagents directly in the synthesis subagent’s prompt.

C.

Spawn the subagent with only a brief task description, relying on automatic context inheritance from the coordinator.

D.

Pass reference identifiers and configure the subagent with read access to a shared memory store where the other subagents deposited their results.

Question 2

You are using Claude Code to accelerate software development. Your team uses it for code generation, refactoring, debugging, and documentation. You need to integrate it into your development workflow with custom slash commands, CLAUDE.md configurations, and understand when to use plan mode vs direct execution.

You’ve asked Claude Code to build a PDF report generation feature. The initial implementation queries the database correctly, but the output has formatting issues: table columns are too narrow causing content truncation, dates display without proper formatting, and page break handling is incorrect. You’ve noticed these issues interact—changing column widths affects how dates render, and page breaks depend on content height.

What’s the most effective approach for iterating toward a working solution?

Options:

A.

Start fresh with a detailed prompt specifying all formatting requirements upfront.

B.

Provide all three issues in a single detailed message with exact specifications for each, allowing Claude to address them together in one update.

C.

Address the column width issue first with specific measurements, verify it works, then fix date formatting within the corrected columns, then adjust page breaks—testing after each change.

D.

Show Claude an example of a correctly formatted report and ask it to match that output, rather than listing the specific technical issues.

Question 3

You are building a structured data extraction system using Claude. The system extracts information from unstructured documents, validates the output using JavaScript Object Notation (JSON) schemas, and maintains high accuracy. It must handle edge cases gracefully and integrate with downstream systems.

Your extraction system implements automatic retries when validation fails. On each retry, the specific validation error is appended to the prompt. This retry-with-error-feedback approach resolves most failures within 2–3 attempts.

For which failure pattern would additional retries be LEAST effective?

Options:

A.

The model extracts keywords as a nested object organized by category when the schema requires a flat array of strings.

B.

The model extracts “et al.” for co-authors when the full list exists only in an external document not in the input.

C.

The model extracts citation counts as locale-formatted strings (“1,234”) when the schema requires integers.

D.

The model extracts dates as ISO 8601 datetime strings (“2023-03-15T00:00:00Z”) when the schema requires only the date portion (YYYY-MM-DD).

Question 4

You are building a customer support resolution agent using the Claude Agent SDK. The agent handles high-ambiguity requests like returns, billing disputes, and account issues. It has access to your backend systems through custom Model Context Protocol (MCP) tools ( get_customer , lookup_order , process_refund , escalate_to_human ). Your target is 80%+ first-contact resolution while knowing when to escalate.

During testing, you find that when a customer says “I need a refund for my recent purchase,” the agent calls process_refund immediately—but populates the required order_id parameter with a plausible-looking but fabricated value instead of first calling lookup_order to retrieve the actual order ID. The refund call fails because the fabricated ID doesn’t exist.

Which change directly addresses the root cause of the agent fabricating the order_id value?

Options:

A.

Update the process_refund tool description to explicitly state that order_id must be obtained from a prior lookup_order call and must never be assumed or invented.

B.

Switch tool_choice from " auto " to " any " to force the agent to make a tool call on every turn.

C.

Add server-side validation that checks whether the order_id exists in your database before executing the refund, returning an error to the agent if not found.

D.

Pre-parse incoming customer messages to extract any order IDs mentioned, and inject them into the conversation context before passing to Claude.

Question 5

You are building a multi-agent research system using the Claude Agent SDK. A coordinator agent delegates to specialized subagents: one searches the web, one analyzes documents, one synthesizes findings, and one generates reports. The system researches topics and produces comprehensive, cited reports.

Production monitoring shows that follow-up queries such as “summarize what we learned about market trends” consistently take more than 40 seconds. Investigation reveals that the coordinator spawns the synthesis subagent for each summarization request, passing more than 80,000 tokens of accumulated findings. The coordinator already has these findings in its context from orchestrating the research.

What is the most effective way to improve response time for these follow-up summaries?

Options:

A.

Spawn the synthesis subagent with reduced context and have it request specific findings from the coordinator on demand.

B.

Have the coordinator handle straightforward summarization requests directly using its existing context, reserving subagent spawning for complex analysis.

C.

Pre-generate and cache summaries at multiple granularities whenever new findings accumulate.

D.

Enable prompt caching on the synthesis subagent to reduce the overhead of repeatedly transferring the same research findings.

Question 6

You are using Claude Code to accelerate software development. Your team uses it for code generation, refactoring, debugging, and documentation. You need to integrate it into your development workflow with custom slash commands, CLAUDE.md configurations, and understand when to use plan mode vs direct execution.

Your infrastructure-as-code repository includes Terraform modules ( /terraform/ ), Kubernetes manifests ( /kubernetes/ ), and CI/CD pipeline scripts ( /pipelines/ ). Each requires different conventions, but your single root CLAUDE.md has grown to 500+ lines. When developers work on Kubernetes files, Terraform-specific rules load into context unnecessarily, consuming tokens.

What is the best approach to reorganize so only relevant guidance loads when editing specific file types?

Options:

A.

Create files in .claude/rules/ with YAML frontmatter path-scoping (e.g., paths: [ " terraform/**/*.tf " ] ), loading rules only when editing matching files.

B.

Restructure the root CLAUDE.md into clearly labeled sections with headers (e.g., “## Terraform Conventions”), improving organization and readability.

C.

Split content into subdirectory CLAUDE.md files ( /terraform/CLAUDE.md , /kubernetes/CLAUDE.md ), so Claude loads directory-specific guidance.

D.

Keep the root CLAUDE.md and use @path/to/import syntax to modularly include tool-specific guidance files from separate documents.

Question 7

In production, you observe that simple fact-checking queries—for example, “What year was the Paris Climate Agreement signed?”—traverse all four subagents sequentially, consuming more than 40 seconds and significant tokens per query. Complex comparative research benefits from the full pipeline. Your query distribution is diverse and evolving as users discover new applications. What is the most effective approach to optimize for varying query complexity?

Options:

A.

Create a fast path for factual questions that bypasses subagents entirely, routing all other queries through the complete pipeline to ensure research thoroughness.

B.

Train a query-complexity classifier on labeled historical data to predict optimal subagent combinations, retraining it periodically as query patterns evolve.

C.

Have the coordinator analyze each query and dynamically decide which subagents to invoke based on its assessment of the query requirements.

D.

Implement pattern-based routing that categorizes queries by structure—single-fact, comparative, or analytical—and maps each category to a predefined subagent combination.

Question 8

You are using Claude Code to accelerate software development. Your team uses it for code generation, refactoring, debugging, and documentation. You need to integrate it into your development workflow with custom slash commands, CLAUDE.md configurations, and understand when to use plan mode vs direct execution.

A security audit requires updating your authentication library from v2 to v3. The migration guide documents breaking changes: authenticate() now returns a Promise instead of accepting a callback, the User type has restructured fields, and three deprecated methods were removed. Grep shows the library is imported in 45 files across several modules.

What’s the most effective approach?

Options:

A.

Create a custom slash command encapsulating the migration transformations, then execute it against each file without prior codebase exploration.

B.

Update the dependency version, run the test suite, and use Claude Code to fix each failure as it appears.

C.

Enter plan mode to explore library usage across modules, map affected code paths, then create a migration strategy before implementing.

D.

Paste the migration guide’s breaking changes into your prompt and use direct execution to update all usages across the 45 files.

Question 9

You are integrating Claude Code into your Continuous Integration/Continuous Deployment (CI/CD) pipeline. The system runs automated code reviews, generates test cases, and provides feedback on pull requests. You need to design prompts that provide actionable feedback and minimize false positives.

Your pipeline reviews every pull request using a single API call with a static prompt containing the diff and the full text of each changed file. Unchanged files are not included. Developers report that reviews consistently miss cross-file bugs—for example, a pull request renames a function’s parameters, but the review does not identify callers in unchanged files that still use the old argument order.

Evaluation shows that cross-file bugs account for 35% of production incidents originating from reviewed pull requests.

What is the most effective change to the review design?

Options:

A.

Build a static dependency graph and include every file located within two dependency hops of a changed file.

B.

Add instructions asking the model to list external references and reason step by step about how each change could affect unseen callers.

C.

Redesign the review as a turn-limited agentic task that can read files and search the repository, following references to verify cross-file findings.

D.

Run separate review passes for each changed file with its direct dependants, and then aggregate and deduplicate the findings through a final consolidation pass.

Question 10

Your pipeline reviews every pull request using a single API call with a static prompt containing the diff and the full text of each changed file; unchanged files are not included. Reviews are posted asynchronously and do not block pull-request creation. Developers report that reviews consistently miss bugs involving cross-file interactions—for example, a pull request renames a function’s parameters, but the review does not flag callers in other files that still use the old parameter names. Post-release analysis shows that cross-file bugs account for 35% of production incidents from reviewed pull requests. What is the most effective change to your review design?

Options:

A.

Redesign the review as a turn-limited agentic task in which the model can read files and search the codebase through tools, following references to verify cross-file findings.

B.

Add chain-of-thought instructions asking the model to list all external references in the diff and then reason step by step about how each change might affect callers in other files.

C.

Use static analysis to build a dependency graph of changed code, and then expand the prompt to include every file within two dependency hops of any changed file.

D.

Run parallel review passes for each changed file with its direct dependents included, and then aggregate and deduplicate the findings through a final summarization call.

Question 11

You have configured the system so that all four subagents have access to the complete set of 18 tools. During testing, agents frequently call tools outside their specialization—the synthesis agent attempts web searches, and the report generator tries to analyze documents. What is the primary cause of this poor tool-selection behavior?

Options:

A.

The agents’ role descriptions in their system prompts conflict with having access to tools outside those roles.

B.

The tool definitions consume too much context-window space, leaving insufficient room for task content.

C.

The coordinator cannot track which capabilities each subagent has, leading to misrouted tasks.

D.

Choosing from 18 tools instead of four or five relevant tools increases decision complexity beyond reliable selection thresholds.

Question 12

Your pipeline reviews approximately 200 database-migration scripts daily using the Message Batches API. Each request includes a shared 8,000-token system prompt containing migration-review guidelines and schema documentation, followed by an individual migration script. You added cache_control breakpoints to the shared system prompt in every request, but monitoring shows cache-hit rates of only 32%, with misses concentrated among requests processed later in the batch window. Which change addresses the root cause without adding sequential-processing latency?

Options:

A.

Split the 200 requests into ten sequential batches of 20, submitting each batch only after the previous batch completes.

B.

Add cache-prewarming requests with max_tokens: 0 at the beginning of every batch.

C.

Move the cache_control breakpoint from the shared system prompt to each migration script so similar code patterns can be reused.

D.

Configure the cache breakpoints to use the extended one-hour TTL instead of the default five-minute TTL.

Question 13

You are building a multi-agent research system using the Claude Agent SDK. A coordinator agent delegates to specialized subagents: one searches the web, one analyzes documents, one synthesizes findings, and one generates reports. The system researches topics and produces comprehensive, cited reports.

The coordinator provides detailed step-by-step instructions to the web-search subagent, specifying exact search queries, source priorities, and date filters. Production monitoring reveals three issues: (1) the subagent reports “insufficient results” rather than trying alternative approaches when the pre-specified searches fail, (2) research quality drops for emerging topics that do not match expected patterns, and (3) the subagent rarely surfaces valuable tangential sources.

What is the most effective way to improve subagent adaptability?

Options:

A.

Specify research goals and quality criteria—coverage breadth, source diversity, and recency—rather than procedural steps, allowing the subagent to determine its search strategy.

B.

Remove procedural details entirely, delegating with simple goals such as “research X thoroughly” and relying on the subagent’s general capabilities.

C.

Add explicit fallback directives to the detailed instructions: “If specified searches yield fewer than N results, attempt alternative query formulations before reporting failure.”

D.

Implement a topic-classification step where the coordinator categorizes requests as “well-defined” or “exploratory” and uses different instruction styles for each category.

Question 14

You are building a structured data extraction system using Claude. The system extracts information from unstructured documents, validates the output using JavaScript Object Notation (JSON) schemas, and maintains high accuracy. It must handle edge cases gracefully and integrate with downstream systems.

Your schema includes a skills: string[] field. Production monitoring reveals three consistency issues: (1) compound phrases like “Python and SQL” are sometimes kept as one entry, sometimes split; (2) implied but unstated skills occasionally appear in extractions; (3) similar documents produce wildly different array lengths (5-10 vs 40+ entries). Your prompt currently says “Extract all skills mentioned.”

What’s the most effective improvement?

Options:

A.

Enrich the schema to {skill: string, confidence: float, source_quote: string}[] to capture extraction metadata.

B.

Add few-shot examples demonstrating compound phrase handling, explicit mention criteria, and appropriate entry granularity.

C.

Add constraints: “Extract 10-20 skills maximum, one skill per entry, only explicitly named skills.”

D.

Add post-extraction normalization that maps skills to a canonical taxonomy and deduplicates similar entries.

Question 15

You are building a structured data extraction system using Claude. The system extracts information from unstructured documents, validates the output using JSON schemas, and maintains high accuracy. It must handle edge cases gracefully and integrate with downstream systems.

After deployment, you find that 12% of extractions contain semantic errors that pass JSON Schema validation—for example, a duration such as “30 minutes” is incorrectly placed in an ingredient-quantity field. Human reviewers have the capacity to check only 20% of extractions.

Which approach most effectively allocates reviewer attention?

Options:

A.

Have the model output field-level confidence scores, and then calibrate review thresholds using a labeled validation set.

B.

Review all extractions from documents with formatting anomalies, such as unusual layouts or mixed content types.

C.

Randomly sample 20% of extractions for review, using corrections to track accuracy and identify error patterns.

D.

Prioritize the review of all extractions where required fields are empty or explicitly marked as not found.

Question 16

You are using Claude Code to accelerate software development. Your team uses it for code generation, refactoring, debugging, and documentation. You need to integrate it into your development workflow with custom slash commands, CLAUDE.md configurations, and understand when to use plan mode vs direct execution.

You’re implementing a caching layer for API responses to speed up the /products endpoint. You have a rough idea—Redis with a 5-minute TTL—but you’re new to production caching and aren’t sure what other considerations a robust implementation requires.

What’s the most effective way to start your iterative workflow?

Options:

A.

Ask Claude to interview you about the caching requirements before implementing, surfacing considerations like invalidation strategies, cache layers, consistency guarantees, and failure modes.

B.

Use plan mode to analyze the current /products endpoint implementation, then provide your caching requirements once Claude explains how the existing code is structured.

C.

Start with a minimal request: “Add Redis caching to /products with 5-minute TTL.” Add features and fix issues through follow-up prompts as problems surface during testing.

D.

Write a specification with your known requirements and “TBD” markers for uncertain areas, having Claude propose solutions for each TBD as it implements.

Question 17

The synthesis agent receives summarized findings from the web-search and document-analysis agents, then passes a consolidated summary to the report generator. During testing, you discover that the generated reports make factual claims without proper citations—the report generator cannot attribute statements to their original sources because that metadata was lost during the summarization steps. What is the most effective approach to ensure proper source attribution in the final reports?

Options:

A.

Have the report generator query the web-search agent to relocate sources for claims in the final report.

B.

Have each agent output structured data that separates content summaries from source metadata, including URLs, document names, and page numbers.

C.

Skip summarization and pass the complete raw outputs from the web-search and document-analysis agents directly to the report generator.

D.

Instruct the synthesis agent to embed source references inline within its summary text using a consistent citation format.

Question 18

You are building developer productivity tools using the Claude Agent SDK. The agent helps engineers explore unfamiliar codebases, understand legacy systems, generate boilerplate code, and automate repetitive tasks. It uses the built-in tools (Read, Write, Bash, Grep, Glob) and integrates with Model Context Protocol (MCP) servers.

Your agent has analyzed a complex service module—reading 23 source files, tracing request flows, and identifying error handling patterns. A developer wants to compare two testing strategies before committing to one: end-to-end tests with mocked external services vs. snapshot tests capturing expected outputs. They need to independently develop both approaches to evaluate trade-offs.

How should you manage the sessions?

Options:

A.

Resume the analysis session with fork_session enabled, creating a separate branch for each testing strategy.

B.

Start two fresh sessions, having each re-read the relevant source files before beginning.

C.

Continue in the original session, developing end-to-end tests first, then snapshot tests sequentially.

D.

Export the analysis session’s key findings to a file, then create two new sessions that reference this file.

Question 19

You are building a customer support resolution agent using the Claude Agent SDK. The agent handles high-ambiguity requests like returns, billing disputes, and account issues. It has access to your backend systems through custom Model Context Protocol (MCP) tools ( get_customer , lookup_order , process_refund , escalate_to_human ). Your target is 80%+ first-contact resolution while knowing when to escalate.

You’re implementing the escalation logic for when the agent should call escalate_to_human . Your team proposes four different approaches for triggering escalation.

Which approach will most reliably identify cases that genuinely require human intervention?

Options:

A.

Build a rules engine that maps specific issue types, customer segments, and product categories to escalation decisions, removing the need for model judgment calls.

B.

Instruct the agent to escalate when the customer requests a human, when the issue requires policy exceptions, or when the agent cannot make meaningful progress.

C.

Configure the agent to escalate after three consecutive tool calls that fail to resolve the customer’s stated issue, ensuring a reasonable attempt before involving a human.

D.

Implement sentiment analysis that monitors for frustration indicators (negative language, repeated questions, exclamation marks) and triggers escalation when the frustration score exceeds a configured threshold.

Question 20

Your automated reviewer uses a single prompt covering security issues, API design, and business-logic correctness. Your evaluation suite shows strong recall for API-design findings at 82% but poor recall for business-logic edge cases in quiz scoring at 34%. When you add few-shot examples of logic bugs to the prompt, logic recall improves to 41%, but API-design recall drops to 68%. How should you address this trade-off to improve detection across both categories?

Options:

A.

Provide the full repository as context instead of only the changed files and surrounding code, giving the model deeper visibility into business-logic patterns.

B.

Replace the few-shot examples with a detailed checklist of specific logic edge cases to verify, such as division by zero in score calculations and boundary conditions in grading thresholds.

C.

Split the review into separate focused prompts—one for security and API design and another for business logic—each with dedicated examples, and then consolidate the findings before posting.

D.

Upgrade to a more capable model tier because its stronger reasoning will handle both concern types in a single prompt and eliminate the recall trade-off.

Question 21

You are using Claude Code to accelerate software development. Your team uses it for code generation, refactoring, debugging, and documentation. You need to integrate it into your development workflow with custom slash commands, CLAUDE.md configurations, and understand when to use plan mode vs direct execution.

You’re implementing a new payment processing module that must follow your project’s established patterns for database transactions, error handling, and audit logging. You’ve identified three existing modules that exemplify these patterns: db_utils.py , error_handlers.py , and audit_logger.py . This is a one-off integration task—these patterns are well-documented in your team wiki and don’t need additional project-level documentation.

What’s the most effective approach?

Options:

A.

Use @ references to include the three modules directly in your prompt, giving Claude concrete code examples of the patterns to follow.

B.

Add documentation of each pattern to your CLAUDE.md file, establishing them as project conventions that Claude will apply automatically.

C.

Describe the patterns from the three modules in natural language in your prompt, explaining the transaction handling approach, error format, and logging conventions Claude should follow.

D.

Ask Claude to explore your codebase to find and understand the transaction, error handling, and logging patterns before generating the new module.

Question 22

You are building developer productivity tools using the Claude Agent SDK. The agent helps engineers explore unfamiliar codebases, understand legacy systems, generate boilerplate code, and automate repetitive tasks. It uses the built-in tools (Read, Write, Bash, Grep, Glob) and integrates with Model Context Protocol (MCP) servers.

Your agent has spent 25 minutes exploring a game engine’s rendering subsystem—reading shader code, buffer management, and frame synchronization logic. An engineer now asks it to understand how the physics engine integrates with rendering for collision debug overlays. You notice recent responses reference “typical rendering patterns” rather than the specific VulkanPipeline and FrameGraph classes it discovered earlier.

What’s the most effective approach?

Options:

A.

Spawn a sub-agent to explore physics independently, then manually synthesize its findings with the rendering knowledge accumulated in the main conversation.

B.

Use /clear to reset context completely, then start fresh with physics exploration using file paths from the project’s CLAUDE.md.

C.

Summarize key rendering findings, then spawn a sub-agent for physics exploration with that summary in its initial context.

D.

Continue in the current context with more targeted prompts referencing the specific classes by name.

Question 23

You are building developer-productivity tools using the Claude Agent SDK. The agent helps engineers explore unfamiliar codebases, understand legacy systems, generate boilerplate code, and automate repetitive tasks. It uses the built-in tools—Read, Write, Bash, Grep, and Glob—and integrates with Model Context Protocol (MCP) servers.

Your agent needs to insert a new helper function into the middle of a 150-line utility module, between two existing functions. The Edit tool fails because its old_string parameter cannot find unique text to match—the file has repetitive docstrings, variable names, and structural patterns.

What is the most reliable way to complete this insertion?

Options:

A.

Use Edit’s replace_all parameter to target a common pattern and embed the new function in the replacement text.

B.

Use Bash to append the function definition to the end of the file using heredoc syntax.

C.

Use Read to load the file, add the function at the appropriate location, and then use Write to overwrite the file with the updated content.

D.

Use Edit with an extremely long old_string capturing more than 30 lines of context to guarantee uniqueness.

Question 24

You are integrating Claude Code into your Continuous Integration/Continuous Deployment (CI/CD) pipeline. The system runs automated code reviews, generates test cases, and provides feedback on pull requests. You need to design prompts that provide actionable feedback and minimize false positives.

Your automated review calls the Claude API for each pull request, using tool_use with a report_findings tool that returns a JSON array of finding objects. Each object contains file_path, line_number, severity, category, and description. During testing on a large pull request touching more than 30 files, the response reaches the max_tokens limit and is truncated in the middle of the JSON, causing your pipeline’s parser to fail.

What is the most effective way to handle this?

Options:

A.

Split the review into multiple API calls that each analyze a subset of the changed files, and then merge the resulting findings arrays.

B.

Increase max_tokens to the model’s maximum and instruct Claude to keep each finding description under 50 words.

C.

Switch from tool_use to prompting Claude to return findings as a Markdown list.

D.

Add retry logic that detects truncated JSON and resends the request with instructions to report only critical and high-severity findings.

Question 25

You are building a customer support resolution agent using the Claude Agent SDK. The agent handles high-ambiguity requests like returns, billing disputes, and account issues. It has access to your backend systems through custom Model Context Protocol (MCP) tools ( get_customer , lookup_order , process_refund , escalate_to_human ). Your target is 80%+ first-contact resolution while knowing when to escalate.

Your process_refund tool returns two types of errors: technical errors (“503 Service Unavailable”, “Connection timeout”) that are transient (~5% of calls), and business errors (“Order exceeds 30-day return window”, “Item already refunded”) that are permanent (~12% of calls). Monitoring shows the agent wastes 3–4 turns retrying business errors that can never succeed. Currently, both error types return only a plain text message to Claude.

What’s the most effective way to reduce wasted retries while improving customer-facing response quality?

Options:

A.

Implement automatic retry logic at the tool layer for technical errors only, passing business errors to Claude without retries.

B.

Add few-shot examples showing how to distinguish retriable from non-retriable errors by parsing error message text.

C.

Add a check_refund_eligibility tool that must be called before process_refund to prevent business rule violations.

D.

Return structured error responses with " retriable " : false for business errors and a customer-friendly explanation for Claude to use.

Question 26

You are integrating Claude Code into your Continuous Integration/Continuous Deployment (CI/CD) pipeline. The system runs automated code reviews, generates test cases, and provides feedback on pull requests. You need to design prompts that provide actionable feedback and minimize false positives.

Your test generation produces unit tests for new code, but reviews show that 55% are low-value: trivial assertions that only verify functions do not throw exceptions, tests duplicating existing coverage, or tests ignoring your team’s fixture conventions.

How do you reduce the rate of low-value tests being generated in the first place?

Options:

A.

Implement two-phase generation in which a second Claude call scores each test against quality criteria, filtering out low-scoring tests before presenting results to developers.

B.

Add post-generation coverage analysis that automatically filters out any generated test that does not increase line coverage beyond existing tests.

C.

Restrict test generation to directories where historical quality metrics show higher acceptance rates, disabling it for areas where generated tests consistently require substantial editing.

D.

Document testing standards in CLAUDE.md, including valuable-test criteria, available fixtures and their intended use cases, and examples distinguishing meaningful behavioral tests from trivial assertions.

Question 27

You are building a customer support resolution agent using the Claude Agent SDK. The agent handles high-ambiguity requests like returns, billing disputes, and account issues. It has access to your backend systems through custom Model Context Protocol (MCP) tools (get_customer, lookup_order, process_refund, escalate_to_human). Your target is 80%+ first-contact resolution while knowing when to escalate.

After expanding the agent’s MCP tools with delivery-specific capabilities (check_delivery_status, contact_driver, issue_credit, apply_promo_code, update_delivery_address, reschedule_delivery), the total tool count has grown from 4 to 10. Your evaluation suite shows tool selection accuracy has dropped from 88% to 71%. Log analysis reveals the majority of errors involve the agent selecting between semantically overlapping tools—calling issue_credit when process_refund was correct, and calling check_delivery_status when lookup_order already returns the needed data.

Which approach structurally eliminates the semantic overlap identified in the logs as the error source?

Options:

A.

Split the tools across two sub-agents—a “financial resolution” agent with process_refund, issue_credit, and apply_promo_code, and a “delivery operations” agent with the remaining delivery tools—with a coordinator routing between them.

B.

Consolidate semantically overlapping tools—merge issue_credit and process_refund into a single resolve_compensation tool with an action parameter, and fold check_delivery_status into lookup_order with an optional include_tracking flag.

C.

Enable the tool search tool with defer_loading on the six new tools, keeping the original four always loaded, so the agent dynamically discovers specialized tools only when needed.

D.

Add few-shot examples to the system prompt demonstrating correct selection for each ambiguous tool pair, such as showing when issue_credit applies versus when process_refund is appropriate.

Question 28

The document-analysis agent has a single analyze_document tool that accepts a document and a free-text instruction parameter. During evaluation, requests such as “extract the key financial metrics” often return narrative summaries, while “summarize the methodology” sometimes returns raw data tables. The synthesis agent reports that 35% of analysis results require new requests with clarified instructions. What is the most effective way to improve reliability?

Options:

A.

Split the generic tool into purpose-specific tools—extract_data_points, summarize_content, and verify_claim_against_source—each with defined input and output contracts.

B.

Retain the single tool but add an analysis_type enum requiring explicit selection among extraction, summarization, and verification modes.

C.

Have the coordinator preclassify each analysis request before passing instructions to the document-analysis agent.

D.

Enhance the tool description with detailed examples showing how different instruction phrasings should map to different output formats.

Question 29

You are using Claude Code to accelerate software development. Your team uses it for code generation, refactoring, debugging, and documentation. You need to integrate it into your development workflow with custom slash commands, CLAUDE.md configurations, and understand when to use plan mode vs direct execution.

Your team has connected a custom MCP server that provides DevOps workflow templates. The server exposes several MCP prompts (such as deploy_checklist and incident_response ) in addition to tools.

How do these MCP prompts become accessible within Claude Code?

Options:

A.

They are automatically prepended to every conversation as additional system-level context, influencing Claude’s behavior throughout the session.

B.

They are added to Claude Code’s tool registry alongside the server’s tools, invoked automatically by the model when relevant to the task.

C.

They are surfaced as @ -mentionable resources alongside files, fetched and attached to your message when referenced.

D.

They appear as slash commands (e.g., /mcp__servername__deploy_checklist ) that you can invoke, with arguments passed after the command name.

Question 30

A developer uses Claude Code to refactor a function during a development session. Before committing, the developer asks the same Claude session to review the code for issues. Later, a separate automated CI review catches several bugs that the same-session review missed. What best explains this discrepancy?

Options:

A.

Claude retains context about its prior reasoning in the session, making it less likely to question its own decisions.

B.

The CI review uses a more specific prompt tailored to catching bugs, while the developer’s request was too general.

C.

The CI environment has access to the complete codebase, while the local session can see only the current file.

D.

The extended session caused the context window to fill with conversation history, leaving insufficient capacity for thorough analysis.

Question 31

You are building developer-productivity tools using the Claude Agent SDK. The agent helps engineers explore unfamiliar codebases, understand legacy systems, generate boilerplate code, and automate repetitive tasks. It uses the built-in tools—Read, Write, Bash, Grep, and Glob—and integrates with Model Context Protocol (MCP) servers.

An engineer who recently joined the team asks the agent to explain the authentication and authorization architecture before making security improvements. The codebase contains more than 800 files across multiple services.

What exploration strategy will most effectively build understanding while respecting context limits?

Options:

A.

Launch parallel subagents to explore every service simultaneously, and then synthesize their findings into an architectural overview.

B.

Read all files containing auth , login , permission , or token in their filenames or contents.

C.

Read all CLAUDE.md and README files first, and then ask the engineer to identify the 10–15 most important authentication files.

D.

Use Grep to locate authentication entry points, read those files, and then follow imports and function calls incrementally to map the authentication flow.

Question 32

You are using Claude Code to accelerate software development. Your team uses it for code generation, refactoring, debugging, and documentation. You need to integrate it into your development workflow with custom slash commands, CLAUDE.md configurations, and understand when to use plan mode vs direct execution.

Your team frequently migrates React components to Vue. You’ve written a step-by-step workflow for Claude Code to follow during each migration, and you want every developer on the team to invoke it by typing /migrate-component . The workflow should stay in sync as the team iterates on it.

Where should you place the skill file?

Options:

A.

In ~/.claude/skills/migrate-component/SKILL.md on each developer’s machine.

B.

As a detailed instruction block in the project’s root CLAUDE.md file.

C.

In the project’s .claude/settings.json using a skillOverrides entry to register and define the workflow.

D.

In .claude/skills/migrate-component/SKILL.md at the project root, committed to version control.

Question 33

You are building developer productivity tools using the Claude Agent SDK. The agent helps engineers explore unfamiliar codebases, understand legacy systems, generate boilerplate code, and automate repetitive tasks. It uses the built-in tools (Read, Write, Bash, Grep, Glob) and integrates with Model Context Protocol (MCP) servers.

Your codebase exploration tool stores session IDs to allow engineers to continue investigations across work sessions. An engineer spent an hour yesterday analyzing a legacy authentication module, building context about its architecture and dependencies. They want to continue today. The session ID is valid, but version control shows 3 of the 12 files the agent previously read were modified overnight by a teammate’s merge.

What approach best balances efficiency and accuracy?

Options:

A.

Start a fresh session to ensure the agent works with current codebase state without stale assumptions

B.

Resume the session and inform the agent which specific files changed for targeted re-analysis

C.

Resume the session and immediately have the agent re-read all 12 previously analyzed files

D.

Resume the session without informing the agent about the changed files

Question 34

You are building developer productivity tools using the Claude Agent SDK. The agent helps engineers explore unfamiliar codebases, understand legacy systems, generate boilerplate code, and automate repetitive tasks. It uses the built-in tools (Read, Write, Bash, Grep, Glob) and integrates with Model Context Protocol (MCP) servers.

A developer asks the agent to investigate why a specific API endpoint intermittently returns 500 errors. The codebase has 200+ files and the developer doesn’t know which components are involved. The agent must trace the error through routing, middleware, business logic, and database layers.

What task decomposition approach would be most effective?

Options:

A.

Have the agent first create a comprehensive plan mapping all code paths through the endpoint before beginning any file exploration or code reading.

B.

Define a fixed sequence of investigation steps upfront—grep for error patterns, then read error handlers, then check database queries, then examine middleware—executing each step regardless of intermediate findings.

C.

Run parallel worker agents that simultaneously investigate all four layers, then synthesize their findings to identify where the error originates.

D.

Have the agent dynamically generate investigation subtasks based on what it discovers at each step, adapting its exploration plan as new information about the error path emerges.

Question 35

You are building a multi-agent research system using the Claude Agent SDK. A coordinator agent delegates to specialized subagents: one searches the web, one analyzes documents, one synthesizes findings, and one generates reports. The system researches topics and produces comprehensive, cited reports.

The coordinator agent has AgentDefinition objects configured for all four specialized subagents, each with appropriate descriptions, prompts, and tool restrictions. During testing, you notice that the coordinator correctly reasons about when to delegate—it generates messages such as, “I’ll ask the web-search agent to find sources on this topic”—but no subagent execution ever occurs. The coordinator then proceeds as if the delegation happened and continues with incomplete information. Logs show no errors.

What is the most likely cause?

Options:

A.

The AgentDefinition objects are configured correctly, but the coordinator’s system prompt does not explicitly list the available subagent types, preventing the model from knowing that they can be invoked.

B.

Subagent context isolation means task descriptions from the coordinator do not automatically reach subagents; you must configure explicit context forwarding in ClaudeAgentOptions.

C.

The coordinator’s allowedTools configuration does not include Agent—formerly named Task—so it cannot invoke the tool required to spawn subagents.

D.

The coordinator’s max_tokens setting is too low, causing the subagent tool invocation to be truncated before the subagent type can be specified.

Question 36

When implementing your lookup_order MCP tool, the backend sometimes returns errors—for example, “Order not found” or temporary database failures. What is the correct pattern for communicating these errors back to the agent?

Options:

A.

Return the error message in the tool-result content with the isError flag set to true.

B.

Return a successful response with a status field indicating the error type.

C.

Log the error server-side and return an empty result to avoid confusing the model.

D.

Throw an exception from the tool handler so the agent framework can catch and log it.

Question 37

You are building a multi-agent research system using the Claude Agent SDK. A coordinator agent delegates to specialized subagents: one searches the web, one analyzes documents, one synthesizes findings, and one generates reports. The system researches topics and produces comprehensive, cited reports.

Production reviews reveal inconsistent handling of uncertainty in final reports. Sometimes conflicting subagent findings are synthesized into a single confident statement, losing important nuance, while other reports use excessive qualifications and become unhelpful. The web-search agent returns, “Industry analysts estimate a $50 billion market size, although methodologies vary.” The document-analysis agent returns, “A peer-reviewed study estimates $35 billion, with a ±$7 billion 95% confidence interval.” The coordinator either selects one estimate arbitrarily or produces a vague $35–$50 billion range.

What systematic approach best addresses this?

Options:

A.

Implement a confidence-calibration layer that normalizes subagent uncertainty expressions to probability scores between 0.0 and 1.0, and then calculate a confidence-weighted average.

B.

Configure subagents to report only findings meeting a high-confidence threshold, filtering uncertain information before it reaches the coordinator.

C.

Add a verification subagent that passes claims to synthesis only when they are corroborated by at least two independent sources.

D.

Instruct the synthesis agent to distinguish well-established findings from contested findings explicitly, preserving each source’s original uncertainty, methodology, and supporting evidence.

Question 38

You are building a structured data extraction system using Claude. The system extracts information from unstructured documents, validates the output using JSON schemas, and maintains high accuracy. It must handle edge cases gracefully and integrate with downstream systems.

Your extraction system parses e-commerce product descriptions to extract specifications such as dimensions, weight, and materials into JSON. Despite having a well-defined schema, the model inconsistently extracts the materials field—sometimes returning “cotton blend,” other times “Cotton/Polyester mix,” and occasionally omitting the field when material information is clearly present in the source.

What is the most effective way to improve extraction consistency?

Options:

A.

Set the temperature to 0 to eliminate randomness and ensure deterministic outputs.

B.

Switch to a more capable model tier because inconsistent extraction indicates insufficient model capability.

C.

Make the materials field required instead of optional in the schema to force the model to always extract a value.

D.

Add few-shot examples showing two or three complete input-output pairs with standardized material-description formats.

Question 39

You are building a structured data extraction system using Claude. The system extracts information from unstructured documents, validates the output using JavaScript Object Notation (JSON) schemas, and maintains high accuracy. It must handle edge cases gracefully and integrate with downstream systems.

Your extraction pipeline processes restaurant menus and must output structured JSON with fields for item names, descriptions, prices, and dietary tags. Some menus use inconsistent formatting—prices as “$12” vs “12.00”, dietary info as icons vs text.

What’s the most reliable approach?

Options:

A.

Use separate extraction calls for each field to ensure consistent handling of each type.

B.

Define a strict output schema and include format normalization rules in your prompt.

C.

Request multiple extraction attempts per document and select the most common format.

D.

Extract data as-is and normalize formats in post-processing code after Claude returns.

Question 40

You are building a customer support resolution agent using the Claude Agent SDK. The agent handles high-ambiguity requests like returns, billing disputes, and account issues. It has access to your backend systems through custom Model Context Protocol (MCP) tools (get_customer, lookup_order, process_refund, escalate_to_human). Your target is 80%+ first-contact resolution while knowing when to escalate.

Production logs show that when the agent handles complex billing disputes requiring 6+ tool calls, it sometimes exhausts its max_turns limit after gathering data but before completing resolution or escalating. The team’s goal is to guarantee that every customer interaction ends with either a completed resolution or a human handoff, regardless of how the agent loop terminates.

Which approach achieves this guarantee?

Options:

A.

Implement a pre-tool-use hook that counts tool invocations and terminates the loop with an automatic escalation once the agent reaches 80% of its max_turns limit.

B.

Split the workflow into two sequential agent invocations—a first agent gathers information via get_customer and lookup_order, then a second agent receives that data and handles process_refund or escalate_to_human, each with separate turn budgets.

C.

Add orchestration-layer code that checks the agent’s outcome after each loop termination—if the loop ended without a completed resolution or escalation, programmatically call escalate_to_human with the accumulated conversation context and tool results.

D.

Add system prompt instructions telling the agent to call escalate_to_human with a summary of its findings whenever it determines it cannot complete resolution within its remaining actions.

Question 41

A customer sends: “This is frustrating. I’ve explained my issue twice and nothing is being resolved. I want to talk to a real person NOW.” The agent has not yet called any tools to investigate the customer’s account. What should the agent do?

Options:

A.

Briefly explain what the agent can help with and offer to resolve the issue quickly, escalating only if the customer repeats the request.

B.

First call get_customer and lookup_order to gather account context, and then escalate to a human agent.

C.

Immediately call escalate_to_human with the conversation history.

D.

Acknowledge the frustration and ask one targeted question to understand the specific issue before escalating.

Question 42

The synthesis agent completes its initial pass but flags that three key research questions remain unanswered because the web-search and document-analysis agents did not find relevant information on those specific subtopics. The coordinator currently proceeds directly to report generation, producing reports with incomplete coverage. What change would most effectively improve research completeness?

Options:

A.

Have the coordinator evaluate the synthesis output for gaps, then redelegate targeted queries to the web-search and document-analysis agents before invoking synthesis again.

B.

Have the report-generation agent identify unanswered research questions so users understand the limitations of the final output.

C.

Increase the initial breadth of queries sent to the web-search and document-analysis agents to reduce the probability of missing relevant information.

D.

Give the synthesis agent direct access to web-search tools so it can autonomously fill knowledge gaps without returning control to the coordinator.

Question 43

You are building a structured data extraction system using Claude. The system extracts information from unstructured documents, validates the output using JSON schemas, and maintains high accuracy. It must handle edge cases gracefully and integrate with downstream systems.

Your extraction system processes two document types: standard monthly reports, which are archived after processing, and urgent exception reports, which must trigger business alerts within 30 minutes of receipt. Both use the same JSON schema. You want to minimize API costs while meeting the latency requirements.

How should you architect the processing pipeline?

Options:

A.

Submit all documents to the Message Batches API with custom_id values for tracking. When results arrive, immediately process urgent documents and trigger delayed alerts for exceptions.

B.

Route standard reports to the Message Batches API for 50% cost savings, and route urgent exception reports to the real-time Messages API.

C.

Queue all documents and submit hourly batches, flagging urgent documents for expedited handling when batch results return.

D.

Submit all documents to the real-time Messages API to ensure consistent processing latency across document types.

Question 44

You are building a structured data extraction system using Claude. The system extracts information from unstructured documents, validates the output using JavaScript Object Notation (JSON) schemas, and maintains high accuracy. It must handle edge cases gracefully and integrate with downstream systems.

Your extraction pipeline processes invoices and extracts line items, subtotals, tax amounts, and grand totals. During evaluation, you discover that in 18% of extractions, the sum of extracted line item amounts doesn’t match the extracted grand total—sometimes due to OCR errors in the source document, sometimes due to extraction mistakes by the model. Downstream accounting systems reject records with mismatched totals.

What’s the most effective approach to improve extraction reliability?

Options:

A.

Add few-shot examples demonstrating invoices where extracted line items sum correctly to the stated total, encouraging the model to produce mathematically consistent extractions.

B.

Extract line items and totals independently, then use a separate validation model to reconcile discrepancies by determining which extracted values are most likely correct.

C.

Implement post-processing that automatically adjusts line item amounts proportionally when their sum doesn’t match the stated total.

D.

Add a “calculated_total” field where the model sums extracted line items alongside a “stated_total” field. Flag records for human review when values differ.

Question 45

Users report that final reports sometimes lack depth on specific subtopics. Investigation shows that the document-analysis agent frequently identifies evidence gaps—for example, noting that “the retrieved sources discuss API authentication but lack details about token-refresh patterns.” Under the current strict pipeline, this insight is not actionable because searching has already finished. What is the most effective architectural change?

Options:

A.

Add a research-planning agent before the initial search phase to decompose every topic into detailed subquestions.

B.

Have the synthesis agent assign confidence scores to each report section and flag insufficiently supported sections for manual review.

C.

Require the analysis agent to return specific evidence gaps to the coordinator, which launches targeted searches and invokes analysis again until the defined coverage criteria are satisfied.

D.

Have the coordinator look for general gap indicators in the analysis output and run additional searches without repeating the analysis stage.

Demo: 45 questions
Total 152 questions