- Describe the house of Lean
- Top is “Goal: Value”
- Left Pillar: “Respect for People”
- Center Pillar: “Product Development Flow”
- Right Pillar: “Kaizen”
- Foundation: “Leadership”
- Describe the goal of value
- Sustainable short-time
- Deliverable quality and value
- Happy cust, low cost safety
- Describe Respect for People
- Develop individuals
- Build partnerships
- Empower
- Describe Kaizen (good change)
- Reflection
- Continuous Improve:
- Retro
- Root Cause Analysis
- Value Stream Mapping
- Describe Leadership
- Trained in Lean
- Decisions on Long-term philosophy
- Describe Product Development Flow
- Economic Framework
- Exploit variability
- Decrease Batch Sizes
- Apply WIP Constraints
- Deal with uncertainty : Cadence and Synchronization
- Fast Feedback
- Decentralized Control
- Describe the Economic Framework
- Cycle Time
- Cost
- Development Cost
- Value
- Risk
- How do you improve cycle time: decrease delays
- If you quantify one thing, what do you quantify: cost of delays
- What do you need to do with queues: actively manage them
- What is Little’s Law: average wait time is Average queue size / Average processing time – think Starbucks
- What is the optimum batch size: well it is based on a U-shaped curve
- If you do nothing else to control batch size what do you do: Apply WIP constraints
- How do you deal with uncertainty? Use cadence and synchronization
- Planning is not for conformance it is for? Alignment
- Why do you want fast feedback: improves learning, reduces cost of risk taking, helped by small batch sizes, requires increased investment in development environment, the shorter the cycle the faster the learning
- When would you not want decentralized control? Infrequent, Global Application, Not time critical
-
What principles in the Agile manefesto are harder to do at scale? Working together, daily face-to-face, architecture
- Traditional development is Plan driven, but Agile is Quality and Value driven
- Traditional development flexes what and fixes what? Flex: Requirements, Fix Cost and Schedule
- Agile development flexes what and fixes what? Flex: Cost and Schedule, Fix: Features
- What things do I fix? Dates and Quality
- Do I fix scope, nope?
- What are the four SAFe values: 1) Alignment 2) Code Quality 3) Program Execution 4) Transparency
- What are the four SAFe business results 1) Engagement 2) Time to Market 3) Quality 4) Productivity
- What is the optimal ART size? 50-125
- Program epics span how many ARTs? 1
- Portfolio epics span how many ARTs? 1 or more
- What is an NFR? Non-Functional Requirement, sit outside the backlog
-
Program Increment (PI) is a fixed timebox; default: 10 weeks, range 8-12
- Do I care that project or the train is on track? the train
- What does a train need to keep going? cadence and synchronization
- A train operates under whose guidance? Arch and UX
- Who puts together the system demos? The system team
- At what levels do I have acceptance criteria? Story and Feature
- Why do we synchronize? To assure delivery
- How big is an Agile Team? 7 plus or minus 2
- What are the five ART roles: 1) Release Train Engineer (RTE), 2) Product Management (program and backlog) 3) System Architect (Arch Runway) 4) System Team (tools) 5) Business Owners (key stakeholders, exec leadership)
- What are the inputs to a program increment: 1) Vision and 2) Features
- What are the outputs to a program increment: 1) Objectives and 2) Business Value
- What is Vision: Strategic Input
- What is a Roadmap: Prioritized features, commitment to the next release, estimates for all other estimates
- What is a Program Backlog? Features (have acceptance criteria and are delivered incrementally)
- What are some attributes to a Feature: 1) Identified, 2) Prioritized 3) Estimated and 4) Maintained
- Who addresses external and internal facing issues: External – Product Manager : Internal – Product Owner
- What are 3 attributes of a Team Backlog: 1) NFRs are constraints against backlog and sit outside the backlog 2) Opportunities not commitments and 3) Owned by the product owner
- What are three attributes about a spike: 1) Have Estimates 2) Are demonstrable 3) If all you do is spikes then you are doing waterfall
- How do we start with a normalized estimate? Start with 1 SP per day to code and test and 4 SP/Dev/Week. Then we move on and don’t look back
- Release Planning is all about Alignment (2 days every 8-12 weeks)
- Who owns the feature priorities? Product Management
- Who owns the story planning and high level estimates? Dev Team
- Inputs to the Release Planning: Vision and Top 10 Features. Output: Program Board and PI Objectives
- What are Stretch Objectives? They count in velocity/capacity, low commitment
- List out Day 1 Release Planning Agenda:
- Business Context – State of Business and Upcoming Objectives
- Product/Solution Vision – Vision and Prioritized Features
- Arch Vision and Dev Practices – Arch, common frameworks, agile tooling, eng. practices
- Planning Context and Lunch – Facilitator explains planning process
- Team Breakouts – Teams develop draft plans, id risks and impediments, arch & prod managers circulate
- Draft Plan Review – Team present draft plans
- Management Review and Problem Solving – Adjustments made
- List out Day 2 Release Planning Agenda:
- Planning Adjustments – adjustments made on yesterdays management review
- Team Breakouts – develop final plans, business value is assigned
- Final Plan Review and Lunch – Teams present final plans
- Program Risks – ROAM risks
- PI Confidence Vote – team and program confidence vote
- Plan Rework if necessary – continue planning until consensus
- Planning Retrospectives and Moving forward
- Describe the four quadrants of the business context: SWOT 1) Strengths, 2) Weaknesses 3) Opportunities 4) Threats
- What program roles would you assign: 1) RTE 2) Executive 3) Product Manager 4) System Arch 5) UX 6) Dev Manager
- What team roles would you assign: 1) Scrum Master 2) Product Owner 3) Team Members
- How do you estimate your initial velocity: 4 SP per Dev/Week
- Walk through the initial parts of a Release Planning Meeting: 1) RTE aligns (purpose) 2) Executive gives SWOT business context 3) Product Manager does vision and features 4) System Arch does arch
- How would you setup your team area: 1) Plan each Sprint X.Y with a) Features b) Velocity c) Load 2) PI and Stretch Objectives and 3) Risks
- What would you do during your team breakout: 1) List your capacity 2) Estimate your stories 3) Sprints are loaded 4) PI Objectives are written in clear business language 5) Stretch objectives are written in clear business lang 6) Risks in red
- So what happens in Team Breakout #2. 1) Business owners assign business value 1-10 2) Finalize plan 3) Consolidate program risks, impediments, and dependencies
- What would I find on a Program Board: 1) Sprint X.Y (Release.Sprint) 2) Features 3) Significant Dependency 4) Milestone/Event 5) String/dependency
- What would I find in the final plan for the Team (Day 2 morning) 1) Changes to Velocity 2) Final PI Objectives and business value 3) Program Risks and Impediments
- Describe ROAMing Risks: 1) Resolved 2) Owned 3) Accepted 4) Mitigated (might also transfer the risk)
- What are inputs to Vision: 1) Strategic Themes 2) Portfolio Backlog 3) Architecture/ART 4) Customer/Value stream feedback 5) Team
- What are outputs to Vision: 1) Program Backlog
- What is the Roadmap: Features over time. Nearest PI is high confidence, next is medium confidence and last is Marque. If a feature spans multiple PIs then indicate when done
- A program epic spans how many trains? 1. NOTE: They can arise locally
- A portfolio epic spans how many trains? 1 or more
- Give me two attributes of features: they have benefit and value. Benefits trace to value
- What should we measure to prioritize: Cost of Delay and Cost to Implement
- Describe Weighted Shortest Job First? Cost of Delay / Duration
- What should I do first, if the COD are equal due the shortest job first. If Duration is equal, do highest COD first.
- So describe Agile Architecture: 1) emergent 2) Intentional 3) runway
- What is an architecture runway? 1) Code 2) Technical enabler 3) Near-term business features
- What does it mean to be intentional architecture? 1) Gen Guidance 2) System level constraints 3) Maintainabilty 4) Avoidance of duplication
- What does an architectural runway provide? 1) Speed and 2) Flexibility
- How do we build an architectural runway? 2) Build incrementally 2) Validate early and often 3) Just enough enablement
- What assists an architectural runway? 1) Design spikes 2) Emergent design 3) Refractoring 4) Modeling 5) Test automation
- What are NFRs (Non Functional Requirments)? 1) “ilities” 2) Persistant constraints a) Port Level apply to all ARTs b) Prog apply to all systems b) team level apply to feature
- How do you deal with product vs architecture discussion 1) Separate concerns 2) Allocate boundaries % a) Product Manager controls business % b) Arch controls arch %
- How often is a system demo held? once per sprint setup by the system team
- How often a scrum of scrums? At least weekly has the RTE and scrum masters
- How do you control code quality? 1) Collective Ownership 2) Pair work 3) Refactor 4) Test-first 5) CI 6) Agile Arch
- When do you automate tests? same iteration and team that codes
- Give me some attributes about acceptance tests: 1) Specific, not flaky 2) automated and manual 3) written in program language or DSL
- How often do you have a release management meeting: once a week with the RTE, Product Mgmt, Dev Mgmt, QA Mgmt
- What does IP stand for? Innovation and Planning sprints – gives you capacity margins. Recently dropped the H for hardening
- What are 3 parts to the inspect and adapt? 1) PI Demo 2) Quantitative 3) Problem Solving.
- How long is the I & A: 3-4 hours per PI
- What is the Release Predicability Report: Compare planned vs. actual business value
- What kind of things would you find on a PI Performance Summary Report? Progress/Functionality (Assess Progress) and Quality metrics (assess program health). Things like Velocity, Stories accepted, Unit Test coverage
- What are the steps in a Problem Solving workshop: 1) Agree to solve the problem 2) Apply RCA, 5 whys 3) Find biggest root cause 4) Restate problem for biggest root cause 5) brainstorm 6) Identify improvement backlog
- Give some attributes of sprint planning: 1) Time-box 2) Prod Owner – what 3) Team how and how much 4) Result Goals and specific value
- If we develop on cadence when do we release? on demand
- When does real-value occur? when end-users are using the software
- Talk to me about the three levels of a iterating 1) Top: Releaseable 2) Middle: System Increment – every 2 weeks 3) Bottom: Working Software
-
Strategic Themes are? Persistent
- What is a value stream? Shows concept to cash, value at scale is distributed goes across organizational boundaries.
- What does it mean to find the kidney? Look at the organizational structures, draw a line around the people that work on this product, looks like a kidney
- A budget supports how many ARTs? 1
- Note there are 2 levels in a portfolio: 1) Value Stream Level and 2) ART level
- Port. Epics cross how many trains? many
- Program Epics cross how many trains? one
- If Epic Owner a position or a role? Role
- Epic value statement is an elevator statement
- What are the parts of a Portfolio Kanban: 1) Funnel (WIP something like 75) 2) Review (WSJF Value State) 3) Analysis 4) Port Backlog 5) Implementing
- WRT cost center budgeting; Traditional keeps boundaries in place, better – moves the people to work
- Define ART: Group of dedicated people organized around a value stream that delivers value
- How do you fund a portfolio backlog? Reserve in your budget funds the port backlog
- Describe Objective Measures: Fact-based milestones
- Describe Portfolio Metrics: 1) Lean Port KPI Metrics 2) Port Kanban boards 3) Measure EPICs 4) Program Port Management Self-Assessment 5) Enterprise balanced scorecard
- List some lean metrics: 1) Benefit 2) Employee Engagement 3) Customer satisfaction 4) Productivity (Cycle Time) 5) Agility 6) Time to Market 7) Quality (Defects) 8) Partner Health
-
Define a knowledge worker? If worker.getKnowledge > boss.getKnowledge then worker.isKnowledgeWorker == True
- NOTE: No useful improvement was ever invented at a desk
- 3 Types of heros 1) Leaders as experts 2) Leaders as conductors and 3) Leaders as developers. #1 and #2 used in hero methodologies #3 is post heros
- When are expert leaders effective: when they have more knowledge
- What is a concern with expert leaders: focus on technology and focus off humans
- What are behaviors of expert leaders: work is when people leave them alone, love their field of work
- Describe a leader as a conductor: 1) Centeralize decisions 2) Harmonies 3) subtle and indirect 4) manage across
- When are conductor leaders effective? When more complex and political issues
- What is a concern with conductor leaders: limits overall
- What are some behaviors of conductor leaders: systems and procedures to control work
- What are some myths with leaders: 1) Leaders must know what is going on everywhere 2) has the most technical expertise 3) can solve any problem 4) primary person responsible for how department is working
- Describe the responsibility cycle trap (if leader feels over responsible, then direct reports feel lower committment and sense of responsibilities
- What are the behaviors of a leader as a developer? Jointly responsible, develops direct reports
- What are the benefits of a leader as a developer? Leader can work laterally and upward
- Describe the four tenets of Lean-Agile Leadership
- Take a systems view
- embrace agile-manefesto
- implement a product development flow
- unlock intrinsic motivation of knowledge workers
- What does it mean to take a systems view
- Understand economy: COD
- Optimize Org whole
- Optimize sw system whole
- Own the System
- Agiln to a mission
- Lean-Agile budgeting
- QUOTE: It is the system that determines quality and productivity, only the manager can change the system
- What does it mean to embrace the agile manifesto?
- Deliver frequently
- Know XP, Scrum, Kanban, SAFe
- Foster excellence
- Kaizen mind and bias for action
- High-performing cross functional
- What is BA: Feeling of 1: Challenge and Question
- What about product development:
- Built-in instablity: specify end-state and put minimal constraints in the middle
- Self-organizing development teams
- Overlapping development phases
- Multi-learning
- Organizational transfer of learning
- subtle control
- So what do you do with product development flow?
- WIP (actively manage)
- Decrease queues
- Decrease batch sizes
- fast feedback
- cadence and synchronization
- variability
- limit demand to capacity
- Unlock motivation of a knowledge worker: life-long learning, decentralize, eliminate MBO
- What are 3 factors lead to a better performance and personal satisfaction
- Autonomy
- Mastery
- Purpose
-
Describe organizing around value
- Deeper look into Value Stream
- Split value stream into ARTs
- Value stream coordination
- Advocating an ART level
- What do you organize around: Features and subsystems; Most ARTS are around Features
- How would you split a value stream: Releasable content, tech boundaries, dependencies, business domain AVOID: Politics and Geography
- What are the dimension of Coordination: Content, Integration/Testing, Releasing, Arch, Infra, Deploy
- What are the high level steps to launching the release train
- Prepare the org
- Choose art launch date and model
- Prepare to launch
- Release planning meeting
- What would you find in charter?
- MIssion and Value
- Metrics
- Operating model
- roles
- What are 2 methods to launch a train? One-week prep (preferred), or take time
- Objectives should be SMART (Specific, Measurable, Actionable, Realistic, Time-based)
- What are some things you change with distributed planning meetings: Logistics, Working Agreements, Distributed Teams, and 2.5 days
- What does ISHIKAWA mean? Fishbones
- Perato: 80% of the problem/effects is a result of the 20% of the root cause