The needed transition is from random sampling to systematic sampling based on typologies requires more initial effort to gain information on a population. However, this results in far lower costs involved in collecting very high quality data in terms of error and representation of data of the target population and its environment. The combination of due diligence procedures and ATs goes a long way towards resolving this issue but there is a need to support this process with clearer guidance on how to specify and apply typologies because these will vary according to the target population.
There is therefore a strong interplay between AT utility and the quality of data collected which can result in ATs evolving to involve more complex algorithms to generate more useful results.State of the art ATs
Angus Raeburn of SEEL, made use of some of the SDGToolkit ATs to demonstrate the advance in the state-of-the-art in these tools. Concerning their development he referred to a triple testing routine involving taking OQSI (Open Quality Standards Initiative) recommendations, completing demonstration of concept to answer the question is the requirement workable? Implementing the AT and testing its operation in the cloud lab by engineers and then testing the same module with stakeholders. There used to be an issue around what is intuitive to engineers and what is intuitive to stakeholders causing some degree of redesign of interfaces. However by standardizing the interfaces by type of AT and providing adequate guidance in the due diligence procedures, this divergence on what is intuitive no longer exists, even with new stakeholders. As a result the testing cycles are now quite short. This is, in reality, a result of engineers descending a learning curve on "what works" and this is invaluable for their possible future roles in technical support, training of users as well as advancing developments.
Although it would be convenient to leave ATs as "standards" this is complicated by the advance in knowledge and user needs. As increasing numbers of ATs are required there is a feedback aspect to learning which helps identify ways to improve existing ATs. This is linked to cognitive ergonomics in the sense that if specific considerations are introduced to early ATs these concepts are easier to comprehend in the context of calculations that occur later in the due diligence sequence involving more complex considerations and datasets. The best example of this is the current work on the multi-factor yield model that was referred to by McNeill. As the data collection response to the advance of knowledge in the areas of locational-state bioclimatic variables becomes more systematic, so then, it is worth investing in more sophisticated ATs to make use of the data in a practical fashion.
| Setting the scene within which a project is designed|
Projects and farm production occur within a national macroeconomic context and quite often the key factors need to be assessed from the state of affairs where a project or farm is operational.
ATs that support Global Constraint Analyses have an important role in justifying projects in terms of realistic challenges such as the real incomes of low income segments, inflation and population growth. Productivity is a critical elements in reducing the negative consequences of population growth and inflation.
Reference: SDGToolkit Global Constraints Analysis, Demonstration of real income projections (March 2021)
A document, "Why was SDGToolkit developed?"
was released as part of the information pack of the Workshop. The relationship between due diligence procedures and the ATs is illustrated in a diagram that appears in this document, as shown below.
As can be seen their role throughout the project design through to operations cycle means that ATs address decision analysis and evidence gathering at many different levels of consideration. For example, quite often, project teams are not concerned with analyzing national level gaps and needs since these are quite often defined by governments or sector analyses by development agencies such as the World Bank. By including national level considerations within a project design and development procedures project teams are able to understand better the nature of the challenges projects need to address. For example, population growth rates, inflation and real income growth are important determinants of the size of the challenge nationally while real incomes can set a cap on the feasibility of projects to sell output three or four years downstream. Sensitivity to the macroeconomic reality helps teams in their design and especially in operations decision making, to keep a project moving towards feasibility. Too many projects find that low income segments cannot afford the output leading to this being redirected to cities and export. As a result the original beneficiaies of the project are ignored and their plight not solved. On the consumption side the very same macroanalyis helps focus attention of projects not only on financial return but also the ability to pay higher real incomes in the context of lowering income disparity.
ATs remain in a logical sequence established by diligence design procedures where the function of the AT is made apparent. The generation of automatic human readable narratives helps avoid misinterpretation of results which in the cases of some more complex analyses is a risk.
The actual utility of ATs is related to the degree that they provide reliant and precise information upon which to base project design decisions. However, there needs to be a coherence between what the tasks are at each phase in a project cycle and the decisions taken to ensure desired objectives linked to that phase activities are achieved. Because following the decision on a project design the assumptions on likely implementation conditions made to guide the design can, and invariably they do, change. Therefore at in each phase ATs have a role in providing support to decision analysis and to a realistic reassessment of likely achievement under changed and changing conditions. Therefore ATs are not simply design stage support but provide an important component of project resilience in supporting ongoing response to change.Project portfolios
Runa Janesen of Plasma.Systems gave a short presentation on the relationship between ATs and databases. Jansen leads the work at Plasma.Systems concerned with the data storage developments at SDGToolkit.com
She emphasised two points. One is that some ATs have an operating system function of locking database sections applying Accumulog technology so as to create immutable sections of what is referred to as a Project Memory (PM) which holds the record of all of the data, simulations, decisions and decision outcomes including end of task evalations. Accumulogs as also used to hold "locked" finally agreed project plan specifications and performance targets, as well as any contractual agreements. Somewhat like one of the cryptocurrency Etherium's functionalities.
The other ATs work with the database on an open and dynamic way during real time simulation reiterations permitting users to save to the PM the more useful options. One important benefit of the AT structures is that something like 90% storage capacity is eliminated by only saving option input values. This means that when options are later to be recalled for comparative analysis, the system generates the projections in tabular, graphic and narrative form in real time. These can use used and even downloaded to MS Office applications and formats.
Each user has a dedicated database server and with the Plasma.Systems techniques, these databases can hold any number of projects in a portfolio together with all of the datasets for each projects and with the capability of running cross porfolio in-depth comparative analyses such as relative performance and identifying common issues of note used to improve the design system procedures. Lessons learned are not in some dusty ignored archive but are integrated into the ongoing systems development.
Future developments include a major investment in locational-state logic in database structures and analysis and aggregation models to facilitate project more detailed comparisons across very large multi-project portfolios.