cc6.1-1-002

CC6.1 · D1 · detection_only

D1
Difficulty
4
Gaps
0
Red Herrings
88%
Avg Score

Task

Review the provided access control policy for NovaTech Solutions. Assess whether the organization's policy adequately addresses the requirements of SOC 2 Trust Service Criteria CC6.1 (Logical Access Security). Identify any gaps, weaknesses, or missing elements that an auditor would flag.

Evidence

Findings

IDTypeSeverityFinding
F-001gaphighNo defined SLA for access revocation upon termination
No defined SLA for access revocation upon termination. Policy says 'timely manner' instead of specifying a concrete timeframe (e.g., same business day, within 24 hours). Auditors require a measurable,...
F-002gaphighMFA not required for production system access
MFA is not required for production system access. Policy mandates MFA for VPN, cloud console, and email from non-corporate devices, but Section 4.2 does not include production servers or databases — t...
F-003gapmediumNo access review completion evidence or artifacts defined
No mention of access review completion evidence or artifacts. Section 5.2 says reviews are 'documented and retained' but does not specify what format, where they are stored, or how long they are retai...
F-004gapmediumRole change access revocation depends solely on manager notification
Role change access revocation depends on the previous manager notifying IT, with no systemic control or verification. If the manager forgets, stale access persists indefinitely. No periodic reconcilia...

Results

ModelProviderScoreRecallPrec.F1GapsReported
Sonnet 4.6Anthropic100%100%36%53%4/411
Opus 4.7Anthropic100%100%36%53%4/411
GPT-5.5OpenAI100%100%20%33%4/420
GPT-4.1OpenAI75%75%30%43%3/410
Haiku 4.5Anthropic100%100%33%50%4/412
GPT-4oOpenAI50%50%40%44%2/45