Day 2 Summary Codex AI Auditor PM Automation

Day 2. Codex Client-based Auditing Practice Summary

Detection of consistency in plan inconsistencies, analysis of impact due to requirements changes, extraction of decision-making logs from messenger unstructured conversation logs, etc. Master the art of combining core design control tasks that cause bottlenecks in practice with the reasoning capabilities of Codex Workspace.

Part 1. Introduction background
Part 2. Practice objectives
Part 3. Follow along
Part 4. How it works
Part 5. Training Guide

Why Codex Client for these three tasks?

In a typical IT service construction process, the point that causes the most time and rework costs is **"planning/design mismatch due to communication error"**. Let's understand the difference between a general-purpose conversation model such as ChatGPT and Codex Client, which holds the entire project file and maintains context.

Critical difference between ChatGPT and Codex Client

Compare items General ChatGPT (single conversation) Codex Client (Workspace-based)
Analysis scope Compare single or fragmented copy-paste text Check overall consistency of multiple documents in project directory
traceability Risk of losing context of previous files as conversation continues Real-time synchronization of inconsistencies between requirements and sub-specifications (API, UI) before and after changes
conversation tablet Risk of simply recording meeting results or creating virtual entities Precise separation of semantic basis (Why) and pending matters (Action Items) in unstructured conversations

Productivity when using AI as a reviewer

Software Engineering Prevention

The cost of correcting errors in the design phase is **up to 100 times** lower than fixing them after development and testing are complete. AI immediately catches design inconsistencies and prevents rework.

Meticulousness as a Reviewer

AI accurately points out fact-centered issues such as missing inactivated rules and mismatched variable mappings (e.g., evaluation subjects are reversed), which are cumbersome for humans to fully inspect, in just a few seconds.

Final result to be created today

Task 01. Design discrepancy detection

Classifies contradictions and omissions between meeting minutes, requirements, and screen designs. Discrepancy Summary Report Table (Output: consistency-report.md)

Task 02. Change impact management

Mapping specific action items to be reflected in screen UI planning and backend API specifications according to new requirements changes Change impact analysis table (Output: impact-analysis.md)

Task 03. Decision tracking

Separate final agreed upon matters (Why) and pending matters requiring future review from unstructured verbal/chat records. Decision Log and Pending Items Table (Output: decision-log.md)

Mission 1 (Task 06). Impact analysis

Analyzing the screens, API, DB, and documents affected by the addition of mobile phone authentication for membership registration Impact analysis report (Output: impact-analysis-report.md)

Mission 2 (Task 07). Write an issue report

Comprehensively analyzes project data and summarizes current progress and major issues. Project issue report (Output: project-issue-report.md)

Input / Output data pipeline

This is the overall workflow map in which input files pass through the Codex Client during the exercise process and are refined into a result table.

01
Mismatch detection
02
Change Impact
03
decision history
M1
Impact analysis
M2
issue report
Task 01. Inconsistency detection data flow
📥 Input (planning/design document)
• meeting-notes.md (meeting notes) • requirements.md (requirements definition) • screen-specification.md (screen-specification)
Codex Client
💾 Output (Summary Report)
| Category | Discover contradictions | Impact | standards | Recommended Action | | policy | Refund fee varies upon withdrawal | High | Meeting minutes | Logic integration | | Features | Evaluation Subject Error | High | Meeting minutes | FR-004 Modification |

STEP 1. Task 01 - Inconsistency detection

After creating a practice file in the project folder, proceed with contradiction auditing by sending the instructions below to the Codex Client prompt window.

🔍 Codex request prompt (instruction to review)

Compare and analyze the three documents ‘meeting-notes.md’, ‘requirements.md’, and ‘screen-specification.md’ in the project folder.

Find and organize items that are contradictory or inconsistent between each document, or items that exist in one document but are missing from the other.
Print the results according to the requirements below.

1. Organize the results in the form of a Markdown table with columns ‘Classification’, ‘Findings and contradictions’, ‘Impact’, ‘Highest authority standard document’, and ‘Recommended action’.
2. When entering development and testing, indicate the impact as ‘high’ for matters that may cause fatal rework.
3. Do not create arbitrary answers, but derive comparative analysis results based on facts only based on the document text.
  • The 10% penalty fee policy for meeting minutes is checked to see if any omissions in the requirements definition are caught.
  • When processing membership withdrawal, check whether policy inconsistencies (automatic cancellation vs. retention vs. hiding without pop-up) in the three documents are identified.
  • In the FR-004 requirements, check whether the logical error in which the evaluation subject was written as Expert rather than Customer was caught.

STEP 2. Task 02 - Change Management

After preparing two types of requirements change files (v1.0 vs v2.0) and existing design/API specifications, we send a change impact mapping directive.

🔄 Codex request prompt (instructs change and impact analysis)

First, analyze which policy has been changed by comparing the 'requirements-before.md' and 'requirements-after.md' files in the project folder.

After that, analyze which part of the ‘screen-specification-v2.md’ and ‘api-specification.md’ documents, which remain at the v1.0 level, where the changed policy content should be reflected.

The results are output in a Markdown table format according to the format below:
1. ‘Change items’, ‘Before change’, ‘After change’, ‘Scope of influence (screen/API)’, ‘Importance’, ‘Actions (guide for specific modifications required)’
2. Additionally, based on the v2.0 requirements, classify the importance of parts that require modification in the order of ‘high/medium/low’ and mark them in the column.
  • Check whether a guide for changing the login screen UI and API parameters (oauth_token) has been established in accordance with Google Social Login.
  • Check whether the subscription UI is replaced according to the introduction of SMS authentication and whether the required API Payload parameters (phone, verification_code) are reflected.
  • Check whether the new dashboard screen is designed according to Admin authority classification and the API role field mapping is checked.

STEP 3. Task 03 - Decision tracking

After preparing an unstructured development chat log (messenger-chat.md), decision logs and follow-up tasks are automatically separated and extracted.

📋 Codex request prompt (instruction to extract decisions)

Read the 'messenger-chat.md' conversation log in the project folder and create Decision Log and Pending Items for project management and tracking.

Please perform the analysis according to the conditions below.
1. For matters that have been decided, please fill out the ‘Decision Log’ table. The column must include ‘decision item’, ‘decision content’, ‘decision background/basis’, ‘decision date’, ‘person in charge/subject’, and ‘status’.
2. Organize matters that have not yet been decided and require follow-up review or are on hold in the ‘Pending Items’ table. In the column, please include ‘Pending items’, ‘Follow-up details’, ‘Person in charge’, and ‘Planned due date’.
3. Please do not write fictitious dates or decision-making entities that are not based on the conversation log text.
  • In the first launch, check whether the basis (delay in review, etc.) and the subject for deciding to only use Google login and exclude Apple login have been extracted.
  • Check whether the reason for holding real-time account transfer, the person in charge (development team) for reviewing overseas Paypal linkage, and follow-up actions have been identified.
  • Ensures that Super/Sub Admin level 2 hierarchical authority component decision basis is included to meet security room audit requirements.

Mission 1. Analysis of the impact of changes in membership registration (Task 06)

We use Codex to analyze the impact of the entire system (screen, API, DB, documents) and create a report in response to the customer's change request to "add mobile phone authentication when signing up."

🔍 Codex request prompt (impact analysis instruction)

If the mobile phone authentication function is added to membership registration, please find all affected screens, APIs, DBs, and documents and prepare an impact analysis report.
  • With the addition of mobile phone authentication, check whether the impact of the sign-up screen (UI) has been detected with the 'High' and 'Modify Screen' actions.
  • Verify that the Login/Signup API impact has been detected as 'Medium' and 'API Modification'.
  • Check whether the influence of the User DB has been mapped to ‘High’ and ‘Add Column’ actions.
  • Make sure you've mapped the impact of your admin screens to 'Low' and 'Add Hit' actions.

Mission 2. Write a project issue report (Task 07)

By analyzing original project data such as meeting minutes, change history, action items, and issue lists, reports on current progress and major issues are automatically created.

📋 Codex request prompt (instructions to write issue report)

Please write a project issue report that summarizes the main issues of the current project and includes urgency and priority.
  • Make sure completion (login function) and progress (membership registration function) status are classified correctly.
  • Check whether the payment API schedule delay issue is prioritized as ‘high’ and PM responsible.
  • Ensure requirements change upcoming risks are mapped to 'High' and Planning Team Responsibility.
  • Confirm the administrator authority policy and confirm that the priority of outstanding matters has been accurately determined as 'medium' and the planning team.

Semantic Diff

It's not just comparing lines of text or detecting changes. Be aware of how the core logic of your business requirements (e.g. email verification ➔ SMS mobile number verification) has been revised; This is the principle of mapping the modification guide by dependently interpreting the variable mapping table of the physical files (front-end UI wireframe design and back-end API REST specifications) that have a dependency relationship with it.

Context encapsulation within unstructured conversations

In the flow of informal group chat rooms, such as “Apple will talk again at the next meeting,” and “Bank transfers are on hold for now due to PG review.” AI semantically refines the background factors that led to the final agreement (Apple developer annual account review schedule, delay in PG company contract approval, etc.). This allows the conference room decision-making background (why) to be fully remembered even if project members change.

Synergy of connection flow of three tasks

The planning/design review process is not a one-time task. It serves as an organic design control device that bridges the planning and development gap in the IT project life cycle.

1. Finding contradictions (Task 01)

Identify conflicts or holes between existing plans, screen designs, and meeting minutes in just a few seconds.

2. Decision tracking (Task 03)

Reporting of the basis and pending work in the meeting conversation that led to the decision to change requirements.

3. Apply controls (Task 02)

Final control to ensure that decision-making results are mapped to sub-UI screens and API specifications without exception.

Instructional Design Specifications

Evaluation items Detailed training standard specifications
Training Difficulty ★★★☆☆ (Intermediate Course)
Estimated lab time 1 hour 30 minutes to 2 hours (including comprehensive practice and feedback)
Practical usability ★★★★★ (Verify IT project consistency and prevent rework)

Planning and design stage final training task

Task topic Take advantage of AI
Task 01 Mismatch detection Compare and verify differences between documents
Task 02 Missing detection Check for missing functions, policies, and exceptions
Task 03 Change Management Change history management and impact analysis
Task 04 Document versioning Compare versions and manage up-to-date documents
Task 05 Decision tracking Management of meeting decisions and action items
Task 06 Impact analysis Analysis of scope of impact based on change requests
Task 07 Project issue report Automatic reporting of project status and issues

Learner questions and discussion topics

“What is the cost difference between performing these three tasks immediately after the meeting and manually comparing them during or after development?”

→ Initial planning specification verification can save up to 100 times the cost and man-hours compared to responding to rework failures that require code repair after all development is completed, greatly protecting business launch schedules.

“Among the AI-derived impact scope analysis results, what is the performance like in detecting minor fields (e.g. API Request Payload) that may be missed by actual developers?”

→ You can experience the performance of accurately identifying input parameters that people tend to inadvertently omit in API specifications during their busy schedules, such as social login tokens and phone number reception specifications for SMS authentication.

← Day 2 Classroom entrance View full roadmap