SIAM Assessment Welcome to our SIAM Maturity Assessment. You will be asked statements in 8 categories (see right column) about the maturity of your House of SIAM. For each statement please indicate if you (strongly) disagree, are neutral or (strongly) agree with the statement. What is your name? What is your email? The current service incentives (credits) deliver improved service performance, collaboration and innovation Strongly disagree Disagree Neutral Agree Strongly agree All processes in scope are implemented and are actively managed. All parties comply to these processes Strongly disagree Disagree Neutral Agree Strongly agree Our existing metrics are meaningful, relevant and aligned to expected business outcomes Strongly disagree Disagree Neutral Agree Strongly agree We have adequate tooling (reports and dashboard) in place to measure and report these performances Strongly disagree Disagree Neutral Agree Strongly agree We are able to visualise (Obeya) the performances and openly discuss it with all parties involved Strongly disagree Disagree Neutral Agree Strongly agree We have a skills framework in place to define the roles and responsibilities across the SIAM ecosystem Strongly disagree Disagree Neutral Agree Strongly agree Employees in each layer of the ecosystem have the right skills to carry out their roles and responsibilities Strongly disagree Disagree Neutral Agree Strongly agree Our retained capabilities and our service integrator work together to build a high-performance partnership Strongly disagree Disagree Neutral Agree Strongly agree The principles of collaboration (code of conduct) are being adhered to, both in mindset and behaviour Strongly disagree Disagree Neutral Agree Strongly agree Collaboration is periodically measured and evaluated; mutual expectations of all parties involved are shared Strongly disagree Disagree Neutral Agree Strongly agree 1 out of 8 For each of the processes in scope we have defined who is process owner and who is responsible for integrated process management Strongly disagree Disagree Neutral Agree Strongly agree Performance of all processes in scope is being measured and communicated to all parties involved Strongly disagree Disagree Neutral Agree Strongly agree We have ongoing organisational change management in place to manage our SIAM trans-formation Strongly disagree Disagree Neutral Agree Strongly agree We have clearly defined the quality requirements our end-to-end services need to comply to Strongly disagree Disagree Neutral Agree Strongly agree We have a technical service catalogue that contains all products and services of our service providers Strongly disagree Disagree Neutral Agree Strongly agree We have linked all products and services of our service providers to our end-to-end services Strongly disagree Disagree Neutral Agree Strongly agree We have clearly defined the quality requirements the products and services of our service providers need to comply to Strongly disagree Disagree Neutral Agree Strongly agree We can visualise our service landscape in a service mapping to have a good insight of the current state Strongly disagree Disagree Neutral Agree Strongly agree We also have a clear view of all new and modified end-to-end services in the service pipeline Strongly disagree Disagree Neutral Agree Strongly agree We regularly evaluate our service catalogue and pipeline and adjust our portfolio when required Strongly disagree Disagree Neutral Agree Strongly agree 2 out of 8 We have defined financial agreements about participation of service providers in process forums and working groups Strongly disagree Disagree Neutral Agree Strongly agree We have clear criteria and a standard process for the onboarding and offboarding of service providers Strongly disagree Disagree Neutral Agree Strongly agree We have a clear governance structure for decision-making (strategical, tactical and opera-tional) Strongly disagree Disagree Neutral Agree Strongly agree For each governance board we have clearly described the participants, chair, frequency, agenda, etc. Strongly disagree Disagree Neutral Agree Strongly agree For each board it is clear if service integrator and/or strategic service providers participate and with which mandate Strongly disagree Disagree Neutral Agree Strongly agree Governance within our organisation supports collaboration and partnership among suppliers and internal capabilities Strongly disagree Disagree Neutral Agree Strongly agree The chosen governance structure for decision-making works satisfactory for all involved parties Strongly disagree Disagree Neutral Agree Strongly agree The effectiveness of our governance is regularly being measured, discussed and improved where necessary Strongly disagree Disagree Neutral Agree Strongly agree We are able to handle escalations and issues between parties in a mature and cooperative manner. Strongly disagree Disagree Neutral Agree Strongly agree Innovation and service improvement are a recurring point on the agenda of boards and process forums Strongly disagree Disagree Neutral Agree Strongly agree 3 out of 8 In process forums we define, measure, analyse and continuously improve the processes in scope Strongly disagree Disagree Neutral Agree Strongly agree We have clearly defined the quality requirements the products and services of our service providers need to comply to Strongly disagree Disagree Neutral Agree Strongly agree With each (external) service provider we have an identified contract (though maybe lim-ited) in place Strongly disagree Disagree Neutral Agree Strongly agree All internal and external service providers recognise the service integrator as our authorised agent Strongly disagree Disagree Neutral Agree Strongly agree We have collaboration agreements in place to ensure service providers work towards a common goal Strongly disagree Disagree Neutral Agree Strongly agree We have clear criteria and a standard process for the onboarding and offboarding of service providers Strongly disagree Disagree Neutral Agree Strongly agree We have regular service reviews with our service providers to discuss performance, collaboration and innovation Strongly disagree Disagree Neutral Agree Strongly agree We have defined financial agreements about participation of service providers in process forums and working groups Strongly disagree Disagree Neutral Agree Strongly agree The current service incentives (credits) deliver improved service performance, collaboration and innovation Strongly disagree Disagree Neutral Agree Strongly agree 4 out of 8 All processes in scope are documented end-to-end, including interfaces with the customer organisation and the service providers Strongly disagree Disagree Neutral Agree Strongly agree We have regular service reviews with our service providers to discuss performance, collaboration and innovation Strongly disagree Disagree Neutral Agree Strongly agree For each of the processes in scope we have defined who is process owner and who is responsible for integrated process management Strongly disagree Disagree Neutral Agree Strongly agree All processes in scope are implemented and are actively managed. All parties comply to these processes Strongly disagree Disagree Neutral Agree Strongly agree Performance of all processes in scope is being measured and communicated to all parties involved Strongly disagree Disagree Neutral Agree Strongly agree In process forums we define, measure, analyse and continuously improve the processes in scope Strongly disagree Disagree Neutral Agree Strongly agree 5 out of 8 We have defined which data is stored in and exchanged between tools and who the data owner is Strongly disagree Disagree Neutral Agree Strongly agree For the tooling in scope the integration requirements are defined, and service providers comply to these requirements Strongly disagree Disagree Neutral Agree Strongly agree The tooling in scope is actively managed both on a functional, applicational and technical level Strongly disagree Disagree Neutral Agree Strongly agree The tooling in scope meets the requirements of the service integrator to adequately perform his role Strongly disagree Disagree Neutral Agree Strongly agree The costs and benefits of tool integration are defined, as well as who will bear these costs/benefits Strongly disagree Disagree Neutral Agree Strongly agree 6 out of 8 The tooling in scope is actively managed both on a functional, applicational and technical level Strongly disagree Disagree Neutral Agree Strongly agree The costs and benefits of tool integration are defined, as well as who will bear these costs/benefits Strongly disagree Disagree Neutral Agree Strongly agree We measure the performance of the end-to-end services, the individual providers and the service integrator Strongly disagree Disagree Neutral Agree Strongly agree Our existing metrics are meaningful, relevant and aligned to expected business outcomes Strongly disagree Disagree Neutral Agree Strongly agree We have adequate tooling (reports and dashboard) in place to measure and report these performances Strongly disagree Disagree Neutral Agree Strongly agree We are able to visualise (Obeya) the performances and openly discuss it with all parties involved Strongly disagree Disagree Neutral Agree Strongly agree 7 out of 8 The tooling in scope meets the requirements of the service integrator to adequately perform his role Strongly disagree Disagree Neutral Agree Strongly agree We measure the performance of the end-to-end services, the individual providers and the service integrator Strongly disagree Disagree Neutral Agree Strongly agree We have a skills framework in place to define the roles and responsibilities across the SIAM ecosystem Strongly disagree Disagree Neutral Agree Strongly agree Employees in each layer of the ecosystem have the right skills to carry out their roles and responsibilities Strongly disagree Disagree Neutral Agree Strongly agree Our retained capabilities and our service integrator work together to build a high-performance partnership Strongly disagree Disagree Neutral Agree Strongly agree The principles of collaboration (code of conduct) are being adhered to, both in mindset and behaviour Strongly disagree Disagree Neutral Agree Strongly agree Collaboration is periodically measured and evaluated; mutual expectations of all parties involved are shared Strongly disagree Disagree Neutral Agree Strongly agree We have ongoing organisational change management in place to manage our SIAM trans-formation Strongly disagree Disagree Neutral Agree Strongly agree 8 out of 8 Time's up
DevOps Foundation Sample Exam You are about to start the DevOps Foundation sample exam. This exam consists of 10 multiple-choice questions. Each multiple-choice has a number of possible answers, of which only one is correct, unless otherwise stated. If you leave your name and email, the correct answers will be sent to you. What is your name? What is your email? There are many reasons for a company to become interested in DevOps. When should companies become interested in DevOps? When Agile practices do not seem to fit the company When no other method gives the necessary results When Scrum and Lean practices have been implemented 1 out of 10 Which requirements should a DevOps team take into account when working on a backlog item? Both non-functional and functional requirements Neither non-functional nor functional requirements Only functional requirements Only non-functional requirements 2 out of 10 A clear Definition of Done is critical in DevOps and considers the value for the customer. What is a good description of Done for DevOps? A requirement is Done when it has been built A requirement is Done when it has been tested A requirement is Done when the product is accepted A requirement is Done when the product is in production 3 out of 10 Tasks need to be prioritized. This prioritization takes place in the queue at the entry of the value stream. Why does this prioritization often cause problems? Because at this point, the decision is made how to build the deployment pipeline for the tasks that can be automated. This takes time, which causes delays. Because enabling measurements of the key indicators in the value stream is done incorrectly or inefficiently, which leads to problems. Because implementation of the use of visualization tools along with WiP-limits, with which one can identify the bottlenecks of the tasks, is done incorrectly. Because the development of the as-is version and the to-be version of the stream must be created, as well as a list of the changes required. This takes a lot of time. Because when many decisions are made before work even starts, like in the traditional approach, this causes massive delays. 4 out of 10 Why is the concept 'value stream' so important in DevOps? The value stream helps employees to see and understand their daily tasks. The value stream helps to analyze the as-is map and any attempts to improve metrics. The value stream helps to identify when someone did their part of the work. The value stream helps to realize a smooth and uniform flow through all process steps. The value stream helps to realize local optimization in the current work practice. 5 out of 10 Which idea is the origin of the concept 'deployment pipeline'? A pipeline that carries a liquid creating flow An assembly line such as a car plant Modern processors that use parallel pipelining The idea of using more than one assembly line The process of deploying people to do different jobs 6 out of 10 For DevOps, finding the balance between moving quickly and maintaining application reliability is important. How does version control support this? By allowing any member of the team to freely delete unnecessary files and documents By allowing the formation of small independent and self-sufficient development teams By applying specialized tools to eliminate or reduce waste and optimize processes 7 out of 10 According to the US National Institute of Standards and technology (NIST), what is NOT an essential cloud computing characteristic? Broad network access Pay-per-use system Rapid elasticity Resource pooling 8 out of 10 In DevOps, what should be done when process deficiencies are found? All changes should be submitted to a backlog, so they can be released in a project or a Kaizen event. Fixes should be found and implemented as soon as possible after detection of the deficiency. Fixes should be found, approved by the change manager, and released based on priority. Fixes should be found, approved by the continuous improvement manager, and released immediately. Fixes should be postponed until the change can be included in an appropriate sprint. 9 out of 10 A value stream map shows clearly where the inefficiencies in a value stream are. Why should a value stream map be made? To help optimize business processes To see which people are not working hard enough To speed up the Work-in-Progress (WiP) To visualize which product line should be ended 10 out of 10 Time's up
SIAM Foundation Sample Exam You are about to start the SIAM Foundation sample exam. This exam consists of 40 multiple-choice questions. Each multiple-choice has a number of possible answers, of which only one is correct, unless otherwise stated. If you leave your name and email, the correct answers will be sent to you. What is your name? What is your email? Which organisation is unlikely to get the full value from SIAM? One with a mix of internal and external service providers One with a single service provider only One with external service providers only One with internal service providers only 1 out of 40 Which driver group in SIAM includes a driver of data and information standards? External drivers Operational efficiencies Service and sourcing landscape Service satisfaction 2 out of 40 What is a responsibility of a service provider in a SIAM ecosystem? Delivery End-to-end integration Governance Strategy 3 out of 40 Which layer of the SIAM ecosystem performs end-to-end assurance? Customer organisation Retained capabilities Service integrator Service provider 4 out of 40 An organization wants to transition to SIAM. They want to avoid service providers making accusations of the service integrator being biased. In which TWO structures is this behaviour most unlikely? Please remember to select two answers. External service integrator Hybrid service integrator Internal service integrator Lead supplier as a service integrator 5 out of 40 In the hybrid service integrator structure, which two parties collaborate to provide the service integrator capability? Customer organisation and external organisation Customer organisation and internal service integrator External service integrator and lead supplier Internal service integrator and retained capabilities 6 out of 40 In which stage of the SIAM roadmap should the principles and policies for roles and responsibilities be defined? Discovery & Strategy Implement Plan & Build Run & Improve 7 out of 40 A provider of hosting services experienced recurring incidents that affected all end-to-end services. Using information from the other service providers, facilitated by the service integrator, they developed an innovation which permanently resolved the underlying root cause. Who should be rewarded? Alle service providers and the service integrator All service providers but not the service integrator The provider of hosting services only The service integrator only 8 out of 40 Which stage of the SIAM roadmap provides an awareness of available technologies and services? Discovery & Strategy Implement Plan & Build Run & Improve 9 out of 40 A customer organization wants to complete the implementation of their SIAM model in the shortest possible time. They are prepared to take risks. What should this organization do to achieve this? Appoint service providers early Implement organisational change management Use a big bang approach Use a phased implementation 10 out of 40 Which TWO stages from the SIAM roadmap include designing the requirements for the SIAM model? Please remember to select two answers. Discovery & Strategy Implement Plan & Build Run & Improve 11 out of 40 In which stage of the SIAM roadmap does organizational change management commence? Discovery & Strategy Implement Plan & Build Run & Improve 12 out of 40 In which stage of the SIAM roadmap should the preferred SIAM structure be selected? Discovery & Strategy Implement Plan & Build Run & Improve 13 out of 40 Which are TWO triggers to start the implementation stage? Please remember to select two answers. An existing service provider ceasing to trade The end of an existing service provider's The implementation of the new SIAM model The selection of the implementation approach 14 out of 40 Which SIAM role is typically accountable for service governance and assurance? Customer organisation Integrated change advisory board Service integrator Service provider 15 out of 40 Who decides what roles and responsibilities in the SIAM model will be sourced externally? Customer organisation External service providers Internal service providers Service integrator 16 out of 40 Which role is accountable for contract management? Customer organisation Executive board Service integrator Tactical board 17 out of 40 What does a single structural element cover? One layer in one organization One layer in multiple organisations Multiple layers in one organisation Multiple layers in multiple organisations 18 out of 40 Which operational role is responsible for discussing lessons learned arising from resolving a major incident? Incident management forum Incident management working group Integrated change advisory board Major incident working group 19 out of 40 Which is not a challenge related to the technology practice for creating a tooling strategy? Gaps between process activities Ineffective legacy tools Non-compliant service providers Toolset scope definition 20 out of 40 When managing cross-functional teams, what does a communication plan provide? An appropriate level of regular communication for all stakeholders Face-to-face meetings between virtual teams are not required Reduced need to re-enter and translate data 21 out of 40 When integrating processes across service providers, which should be used to identify and avoid gaps in process flows? DevOps Key Performance Indicator (KPI) RACI matrix Service Level Agreement 22 out of 40 Which is a main challenge associated with cross-functional teams? Conflicting objectives, organizational strategies and working practices Gaps between process activities Inability to map end-to-end workflow Lack of architecture 23 out of 40 There are a number of practices associated with creating a tooling strategy. Which practice helps the service integrator and service providers understand how the SIAM toolset will evolve? Adopting a common data dictionary Industry standard methods Ownership of data and toolsets Technology strategy and roadmap 24 out of 40 Which is an example of end-to-end measurement in a SIAM environment? Average time to resolve a problem by a particular service integration partner Comparison of internal versus external service providers How many incidents have been raised by a particular business division Responsiveness of the service against service level targets 25 out of 40 Which consideration is common for all processes in a SIAM ecosystem? Aligning resolution targets across service providers Processes can seem more complex The requirement for a data dictionary, terminology, and thresholds 26 out of 40 Which is the purpose of the continual service improvement process? To encourage and incentivize service providers to contribute to continual service improvement To ensure that continual service improvement is on the agendas of SIAM governance boards To provide a consistent method of quantifying, tracking, and managing the delivery of improvement activity To share lessons learned across all parties in the SIAM ecosystem 27 out of 40 Tom is the problem manager in a service provider. What is the purpose of Tom's problem management process? Coordinating problem investigation and resolution activities across multiple service providers Getting all parties to take part in joint working to resolve problems Preventing incidents and problems from occurring or recurring Restoring service in an agreed timescale dictated by priority 28 out of 40 Which process has as its main purpose an early detection and avoidance of system and service outages? Change and release management Continual service improvement Event management Incident management 29 out of 40 Which SIAM consideration is common for all processes in a SIAM ecosystem? Building and maintaining strong relationships between service providers and the consumers of their services Defining ownership of the processes and the levels of accountability and responsibility Providing a consistent method of quantifying, tracking and managing the delivery of improvement activities Providing a structured approach that delivers projects on time, on budget and at the appropriate level of quality 30 out of 40 Which is a SIAM consideration of the monitoring and measuring process? Requirements for consistent data dictionary, data models, terminology, thresholds and reporting schedules. Responsibilities for testing integration between services from different service providers should be defined. Targets for event diagnosis and resolution should be common across service providers. 31 out of 40 Which is a SIAM consideration of the incident management process? Defining rules for managing event thresholds Ensuring all service providers are able to monitor their services Managing events that are degrading or could degrade service performance Minimising the number of parties involved in restoring a service 32 out of 40 Which is the earliest stage of the SIAM roadmap to be affected by the challenge of building the business case? Discovery & Strategy Implement Plan & Build Run & Improve 33 out of 40 Which SIAM layer is NOT affected by the challenge of measuring success of SIAM? Customer organisation Service integrator Service provider 34 out of 40 A customer organization sets unrealistic service levels for one of their service providers. Which risk is directly related to this? It could be difficult to allocate responsibility for service failures The customer's data may be at risk The service integrator may not be able to fulfil their role The service provider may withdraw from the ecosystem 35 out of 40 A customer organization is unable to map dataflows and the end-to-end service leaving them unable to understand the scope for security in their SIAM ecosystem. Which risk is directly related to this? Service providers may have access to data to which they are not entitled Service providers might not achieve their service targets The cost of implementing SIAM could be higher than planned The service integrator might have an increased workload 36 out of 40 In a SIAM ecosystem, service providers need to adapt to a new way of working. Which is an associated cultural consideration? Creating an environment for service providers that is focused on contracts and agreements Service providers acknowledging that the service integrator has the autonomy to direct, make decisions and govern Service providers focusing on the achievement of their own specific service levels and objectives 37 out of 40 Defining the level of control and ownership to be retained by a customer organization is important. Which is a risk of leaving this undecided? It will be challenging to assign responsibility for service failures Service providers may be unwilling to collaborate The service integrator may be unable to perform its role The success of the SIAM program cannot be measured 38 out of 40 How are ITIL processes and SIAM related? ITIL process outcomes are different from SIAM process outcomes and provide other insights ITIL processes can be used in a SIAM ecosystem without any adaptation SIAM builds on the ITIL's service management elements and extends them SIAM is a replacement for ITIL and therefore does not use any of its processes 39 out of 40 Which practice focuses on creating a collaborative culture and sharing? DevOps ISO/IEC 20000 ITIL Lean 40 out of 40 Time's up