{"id":9170,"date":"2026-08-04T15:43:50","date_gmt":"2026-08-23T13:04:42","guid":{"rendered":"https:\/\/pst.knu.ua\/?page_id=9170"},"modified":"2026-08-26T21:14:10","modified_gmt":"2026-08-26T18:14:10","slug":"evaluation-stem-projects","status":"publish","type":"page","link":"https:\/\/pst.knu.ua\/en\/academics\/bachelor\/evaluation-stem-projects\/","title":{"rendered":"Recommendations for the evaluation of educational stem projects"},"content":{"rendered":"<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-8f761849 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:55%\"><\/div>\n\n\n\n<div class=\"wp-block-column is-vertically-aligned-top is-layout-flow wp-block-column-is-layout-flow\">\n<p class=\"wp-block-paragraph\">APPROVED<br>at the meeting of the<br>Department of software systems and technologies<br>Minutes No. 16 dated May 01, 2026.<\/p>\n<\/div>\n<\/div>\n\n\n\n<h2 class=\"wp-block-heading\">1. Purpose and principles<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">According to the Concept for the Development of Natural and Mathematical Education, approved by the Cabinet of Ministers of Ukraine on August 5, 2020, stem education forms competencies using a transdisciplinary approach to learning. This approach is based on the practical application of scientific, mathematical, technical and engineering knowledge and skills for their further use in professional activities. <br>For the formation of competencies provided by the educational programs of the Department of Software Systems and Technologies, the stem project is an important component that implements the principles of stem education within software engineering. <br>By the number of participants, an educational stem project can be individual or team. According to the number of components within which the project is implemented, the student has the right to choose a single-component or multicomponent stem project. Subject to the joint implementation of the task by representatives of different departments or specialties, the stem project is classified as interdepartmental or intersectoral.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Evaluation of a stem project is carried out according to the following basic principles:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Multicriteria with the use of weighting coefficients. Each criterion has a fixed weight. The result according to a separate criterion is calculated in proportion to the percentage of its implementation.<\/li>\n\n\n\n<li>Objectivity and measurability. The level of performance is determined solely by quantitative metrics. These include: the share of successfully completed test cases, the percentage of code coverage by tests, the absence or presence of comments from static code analysis tools (for example, cpplint or Roslyn Analyzers), compliance with deadlines for tasks and compliance with checklists. This minimizes the subjectivity of the assessment.<\/li>\n\n\n\n<li>Differentiation in the complexity of the individual zone in team projects. At the initial stage of control, each applicant's personal area of responsibility and the level of its complexity are recorded. <\/li>\n\n\n\n<li>Academic integrity as a defining condition. Observance of the principles of academic integrity is applied not as a separate criterion, but as an external factor to the total score. <\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">An educational stem project is considered credited only if the final percentage of its implementation by the applicant is not less than 60\u00a0%. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\">2. Formulas for calculating the assessment for the project<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Score for <em>i<\/em>-th criterion (<math data-latex=\"K_i \"><semantics><msub><mi>K<\/mi><mi>i<\/mi><\/msub><annotation encoding=\"application\/x-tex\">K_i <\/annotation><\/semantics><\/math>) as a percentage is calculated by the formula:<\/p>\n\n\n\n<div class=\"wp-block-math\"><math display=\"block\"><semantics><mrow><msub><mi>K<\/mi><mi>i<\/mi><\/msub><mo>=<\/mo><msub><mi>k<\/mi><mi>i<\/mi><\/msub><mo>\u22c5<\/mo><msub><mi>r<\/mi><mi>i<\/mi><\/msub><mo separator=\"true\">,<\/mo><\/mrow><annotation encoding=\"application\/x-tex\">K_i=k_i \\cdot r_i,<\/annotation><\/semantics><\/math><\/div>\n\n\n\n<p class=\"wp-block-paragraph\">Wherein <math data-latex=\"k_i\"><semantics><msub><mi>k<\/mi><mi>i<\/mi><\/msub><annotation encoding=\"application\/x-tex\">k_i<\/annotation><\/semantics><\/math> \u2013 weight fraction <em>i<\/em>-th criterion; <math data-latex=\"r_i \"><semantics><msub><mi>r<\/mi><mi>i<\/mi><\/msub><annotation encoding=\"application\/x-tex\">r i <\/annotation><\/semantics><\/math> \u2013 level of implementation <em>i<\/em>-th criterion (in percent). <br>Final percentage of project implementation (<math data-latex=\"P \"><semantics><mi>P<\/mi><annotation encoding=\"application\/x-tex\">P <\/annotation><\/semantics><\/math>) is defined as:<\/p>\n\n\n\n<div class=\"wp-block-math\"><math display=\"block\"><semantics><mrow><mi>P<\/mi><mo>=<\/mo><mi>M<\/mi><mo>\u22c5<\/mo><mrow><munderover><mo movablelimits=\"false\">\u2211<\/mo><mrow><mi>i<\/mi><mo>=<\/mo><mn>1<\/mn><\/mrow><mi>n<\/mi><\/munderover><\/mrow><msub><mi>K<\/mi><mi>i<\/mi><\/msub><mo separator=\"true\">,<\/mo><\/mrow><annotation encoding=\"application\/x-tex\">P = M \\cdot \\sum_{i=1}^n K_i,<\/annotation><\/semantics><\/math><\/div>\n\n\n\n<p class=\"wp-block-paragraph\">where n is the total number of criteria; M is the academic integrity multiplier (see section 3). <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Final number of points for the project (<math data-latex=\"B\"><semantics><mi>B<\/mi><annotation encoding=\"application\/x-tex\">B<\/annotation><\/semantics><\/math>) is calculated by the proportion: <\/p>\n\n\n\n<div class=\"wp-block-math\"><math display=\"block\"><semantics><mrow><mi>B<\/mi><mo>=<\/mo><mfrac><mrow><mi>P<\/mi><mo>\u22c5<\/mo><msub><mi>B<\/mi><mrow><mi>m<\/mi><mi>a<\/mi><mi>x<\/mi><\/mrow><\/msub><\/mrow><mrow><mn>100<\/mn><mi>%<\/mi><\/mrow><\/mfrac><mo separator=\"true\">,<\/mo><\/mrow><annotation encoding=\"application\/x-tex\">B = \\frac{P \\cdot B_{max}}{100\\%},<\/annotation><\/semantics><\/math><\/div>\n\n\n\n<p class=\"wp-block-paragraph\">Wherein <math data-latex=\"B_{max}\"><semantics><msub><mi>B<\/mi><mrow><mi>m<\/mi><mi>a<\/mi><mi>x<\/mi><\/mrow><\/msub><annotation encoding=\"application\/x-tex\">B_{max}<\/annotation><\/semantics><\/math> \u2013 the maximum number of points provided for in the draft work program of the discipline (LTP).<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">3. Academic Integrity and AI Policy<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Observance of the principles of academic integrity is applied as an external factor <em>M<\/em> to the final score:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><em>M<\/em> = 1.0   \u2013 no violations were detected.<\/li>\n\n\n\n<li><em>M<\/em> = 0.5   \u2013 violations were detected: plagiarism, borrowing code\/layouts without proper attribution, undeclared use of generated code.<\/li>\n\n\n\n<li><em>M<\/em> = 0.0   \u2013   gross falsification of results or impersonation of someone else's work. In this case, the final score is zero, and the materials are submitted to the relevant commission.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Policy on Generative AI and Related Tools and Technologies<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The use of metaprogramming tools in a broad sense, in particular AI code generation tools and other services related to the generation and automatic processing of texts in formal and informal languages, during the project work is allowed (and, depending on the task of the work, may be recommended) under the following prerequisites:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Declaration: in the META-USAGE file, the applicant describes the applied programming principles (purpose), their advantages and limitations in the context of project work, and also indicates the specific tools used, key requests for them, generated code snippets, etc.;<\/li>\n\n\n\n<li>Material proficiency: during the defense, the applicant demonstrates knowledge of the content of the META-USAGE file, in particular the ability to answer additional questions about the chosen strategy for using the mentioned tools and reasonably compare it with alternative approaches studied within this or previous disciplines;<\/li>\n\n\n\n<li>Understanding of the generated content: in defense, the applicant confirms understanding of the content of the generated code fragments or artifacts, ways to check their quality (in particular, correctness, effectiveness, etc.) and possible ways of their further use.<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">The undeclared generated result qualifies as a violation of academic integrity in accordance with \u201c<a href=\"https:\/\/senate.knu.ua\/?p=2104\" data-type=\"link\" data-id=\"https:\/\/senate.knu.ua\/?p=2104\">Regulations on Ensuring Academic Integrity at Taras Shevchenko National University of Kyiv<\/a>\", enacted by Rector's Order No. 569-32\u00a0dated October 05, 2022. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\">4. Principles of team stem project evaluation <\/h2>\n\n\n\n<p class=\"has-text-align-right wp-block-paragraph\"><em><strong>Project assessment is an assessment of THE APPLICANT for work in a team project, not a team assessment.<\/strong><br><\/em><\/p>\n\n\n\n<p class=\"has-text-align-left wp-block-paragraph\">To ensure objectivity, the evaluation criteria are divided into two components:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The team unit makes up 30% of the overall project score. The team creates a single product, so its quality is a shared responsibility and is evaluated equally for all team members. This forms the right motivation: the applicant is interested not only in performing his own area of work, but also in bringing the common product to working condition and successful integration of all components.<\/li>\n\n\n\n<li>The individual part is 70% of the overall project evaluation. Individual contribution to the project is assessed for each applicant separately.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Below are two headings: for programming and mathematical disciplines.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">4.1. Section A \u00b7 Programming \/ Databases<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Block C \u2013<\/em> <em>command component (the same for everyone in the team). Blocks A, B, D, E are individual. Data sources: version control system (Git: issue \u2192 branch \u2192 PR committees \u2192 \u2192 review \u2192 merge), task tracker, tool reports (coverage, linter), fixed set of acceptance test cases, protection.<\/em><\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td><strong>Code<\/strong><\/td><td><strong>Criterion<\/strong><\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong>Weight<\/strong> <strong>(<math data-latex=\"k\"><semantics><mi>k<\/mi><annotation encoding=\"application\/x-tex\">k<\/annotation><\/semantics><\/math>)<\/strong><\/td><td><strong>Criterion level (<math data-latex=\"r\"><semantics><mi>r<\/mi><annotation encoding=\"application\/x-tex\">r<\/annotation><\/semantics><\/math>), <strong>%<\/strong><\/strong><\/td><\/tr><tr><td colspan=\"4\"><strong>A. Process and discipline (individual)<\/strong><\/td><\/tr><tr><td><strong>A1<\/strong><\/td><td>Compliance with intermediate deadlines (3 checkpoints)<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong>0,06<\/strong><\/td><td>All 3 checkpoints passed on time with a complete list of \u2192 100% artifacts; 1 stage with a delay \u226424 h \u2192 80%; 2 of 3 on time \u2192 60%; 1 of 3 \u2192 40%; none or post factum \u2192 0%.<\/td><\/tr><tr><td><strong>A2<\/strong><\/td><td>Repository \/logbook maintenance (Git history check)<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong>0<\/strong>,05<\/strong><\/td><td>20% for each item: (1) \u22651 substantive commit per week; (2) committees tied to the issue; (3) README with launch instructions; (4) solution log \u22655 \u201c\u2192solution problem\u201d entries; (5) using a branch model (avoiding direct commit in main).<\/td><\/tr><tr><td><strong>A3<\/strong><\/td><td>Feedback processing<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong>0,<\/strong>04<\/strong><\/td><td>The total percentage of criterion fulfillment = the percentage of processed comments from checkpoints issued as an issue and closed until the next stage (0\u2013100%).<\/td><\/tr><tr><td colspan=\"4\"><strong>B. Contribution and reliability (<strong>Individual<\/strong>)<\/strong><\/td><\/tr><tr><td><strong>B1<\/strong><\/td><td>Fulfillment of the individual area of responsibility<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong>0,12<\/strong><\/td><td>The zone is fixed at the initial stage of the project. The level is assessed by a set of artifacts (issue \u2192 branch \u2192 PR committees \u2192 review \u2192 merge chain; code, architectural solutions, tests, documentation, debugging); story points are only one of \u2192 the evidence, not an end in itself. Full volume qualitatively \u2192 100\u00a0%; mainly (minor gaps) \u2192 80\u00a0%; partially \u2192 60\u00a0%; fragmentary \u2192 40\u00a0%; minimum \u2192 20\u00a0%; \u2192 0 % not performed.Authorship is determined by the work performed, not by git blame.<\/td><\/tr><tr><td><strong>B2<\/strong><\/td><td>Fulfillment of obligations and risk communication<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong>0,08<\/strong><\/td><td>The total percentage of criterion fulfillment = the percentage of tasks taken that are EITHER completed within the agreed time frame, OR for which the risk\/delay in advance (before the deadline) is communicated with the issue update and the new date (0\u2013100\u00a0%). Silent failure of the deadline \u2013 not counted (0\u00a0%).<\/td><\/tr><tr><td><strong>B3<\/strong><\/td><td>Code-review performance<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong>0,05<\/strong><\/td><td>Only effective reviews are counted (the review of someone else's PR \u2192 found a significant problem or suggested a reasonable improvement, the \u2192 author responded with a \u2192 verified correction). \u22653 effective \u2192 100 %; 2 \u2192 80 %; 1 \u2192 50 %; 0 \u2192 0\u00a0%. Small cosmetic comments are not taken into account.<\/td><\/tr><tr><td colspan=\"4\"><strong>C. Technical quality of the product (TEAM \u2013 the same for all)<\/strong><\/td><\/tr><tr><td><strong>C1<\/strong><\/td><td>Functional correctness (acceptance cases)<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong>0,12<\/strong><\/td><td>The total percentage of criterion fulfillment = passed acceptance test cases \/ total number of agreed cases (fixed list of cases) \u00d7 100\u00a0%.<\/td><\/tr><tr><td><strong>C2<\/strong><\/td><td>Handling of extreme cases and errors<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong>0,05<\/strong><\/td><td>20 %\u00a0for each item: (1) input validation; (2) processing of empty\/incorrect data; (3) processing of exceptions without crashing; (4) boundary values; (5) no raw exceptions in the run log file.<\/td><\/tr><tr><td><strong>C3<\/strong><\/td><td>Autotests and Coatings<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong>0<\/strong>,0<\/strong>6<\/strong><\/td><td>100% autotests \u2192 + coverage \u226580% (tool report) + CI automatically runs tests; <br>80% \u2192  autotests + coverage \u226560%; <br>60% \u2192 autotests + coverage \u226540%; <br>40% autotests \u2192 are available, coverage is &lt;40%; <br>There are no 0% \u2192 autotests.<\/td><\/tr><tr><td><strong>C4<\/strong><\/td><td>Code quality by static analysis<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong>0<\/strong>,04<\/strong><\/strong><\/td><td>Critical\/major comments of the linter analyzer per 1000 lines: 0 \u2192 100%; \u22642 \u2192 80%; \u22645 \u2192 60%; \u226410 \u2192 40%; &gt;10 \u2192 0%. Instrumental check (pylint\/ESLint\/SonarQube).<\/td><\/tr><tr><td><strong>C-5<\/strong><\/td><td>Integrity and safety of working with data \/DB schema<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong>0<\/strong>,03<\/strong><\/td><td>20 %\u00a0for each item: (1) normalization \u22653NF or reasonable denormalization; (2) PK\/FK and integrity constraints; (3) search field\/JOIN indexes; (4) parameterized queries (injection protection); (5) transactions where required. For projects without DB \u2013 equivalent for file data (validation, transactionality, consistency).<\/td><\/tr><tr><td colspan=\"4\"><strong>D. Complexity of the area of responsibility (individual)<\/strong><\/td><\/tr><tr><td><strong>D1<\/strong><\/td><td>Complexity and completeness of the individual area of responsibility<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong>0<\/strong><\/strong>,1<\/strong><\/td><td>The zone is fixed at the initial stage (for individual projects \u2013 the entire project). The total percentage of criterion fulfillment = difficulty level \u00d7 completeness of fulfillment. Difficulty levels: expert (event-driven backend, complex authorization, distributed workers, etc.) \u2192 1.0; advanced \u2192 0.9; basic \u2192 0.8. Completeness: fully \u2192 100 %, partially\/simplified \u2192 in proportion to the percentage of work performed (30-80 %); trivial contribution (e.g.README + template CRUD) \u2192 20 %; \u2192 0 %\u00a0failed.<\/td><\/tr><tr><td colspan=\"4\"><strong>E. Protection and understanding (individual)<\/strong><\/td><\/tr><tr><td><strong>E1<\/strong><\/td><td>Answers to an open-ended set of questions<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong>0<\/strong><\/strong>,12<\/strong><\/td><td>The applicant receives <em>K<\/em> questions on the published set. Each answer: full \u2192 100\u00a0%, partial \u2192 50\u00a0%, no \u2192 0\u00a0%.<br>The total percentage of the criterion fulfillment = the sum of the percentages for the answers \/ <em>K<\/em>.<\/td><\/tr><tr><td><strong>E2<\/strong><\/td><td>Modification of On-the-Fly Condition<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong>0<\/strong>,0<\/strong>5<\/strong><\/td><td>Two pre-prepared micro-change conditions. Each correctly explained\/implemented \u2192 50 %; partially modified or with errors \u2192 25\u00a0%; cannot make changes \u2192 0\u00a0%. The total percentage of the criterion fulfillment = the sum of the percentages for the responses.<\/td><\/tr><tr><td><strong>E3)<\/strong><\/td><td>README Launch Demonstration<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong>0<\/strong>,0<\/strong>3<\/strong><\/td><td>The project is started from scratch by README without author intervention within the defined time limit of \u2192 100 %; with small intervention of \u2192 50\u00a0%; \u2192 0 % is not started.<\/td><\/tr><tr><td colspan=\"2\"><strong>\u0420\u0410\u0417\u041e\u041c (sum of weights)<\/strong><\/td><td><strong>1,00<\/strong><\/td><td class=\"has-text-align-center\" data-align=\"center\"><\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">4.2. Section B \u00b7 Mathematical disciplines<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Block C \u2013<\/em> <em>command component. Blocks A, B, D, E are individual. Data sources: workbook and intermediate calculations, reference set of tasks\/cases for reconciliation of results, reproducible calculation script, protection.<\/em><\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td><strong>Code<\/strong><\/td><td><strong>Criterion<\/strong><\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong>Weight<\/strong> <strong>(<math data-latex=\"k\"><semantics><mi>k<\/mi><annotation encoding=\"application\/x-tex\">k<\/annotation><\/semantics><\/math>)<\/strong><\/strong><\/td><td><strong><strong><strong>Criterion level (<math data-latex=\"r\"><semantics><mi>r<\/mi><annotation encoding=\"application\/x-tex\">r<\/annotation><\/semantics><\/math>), <strong>%<\/strong><\/strong><\/strong><\/strong><\/td><\/tr><tr><td colspan=\"4\"><strong>A. Process and discipline (individual)<\/strong><\/td><\/tr><tr><td><strong>A1<\/strong><\/td><td>Compliance with intermediate deadlines (3 checkpoints)<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong><strong>0<\/strong>,0<\/strong><\/strong>6<\/strong><\/td><td>All 3 checkpoints passed on time with a complete list of \u2192 100% artifacts; 1 stage with a delay \u226424 h \u2192 80%; 2 of 3 on time \u2192 60%; 1 of 3 \u2192 40%; none or post factum \u2192 0%.<\/td><\/tr><tr><td><strong>A2<\/strong><\/td><td>Keeping a work log \/ execution of intermediate results<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong>0,<\/strong>0<\/strong>5<\/strong><\/td><td>20 %\u00a0for each item: (1) weekly progress records; (2) each result is dated and contains a method\/source reference; (3) intermediate calculations are saved and reproducible; (4) error\/correction log \u22655 records; (5) final materials are structured (LaTeX\/Jupyter Notebook).<\/td><\/tr><tr><td><strong>A3<\/strong><\/td><td>Feedback processing<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong>0<\/strong>,0<\/strong>4<\/strong><\/td><td>The total percentage of criterion fulfillment = the percentage of processed comments from checkpoints taken into account and closed until the next stage (0\u2013100%).<\/td><\/tr><tr><td colspan=\"4\"><strong>B. Contribution and reliability (individual)<\/strong><\/td><\/tr><tr><td><strong>B1<\/strong><\/td><td>Execution of the individual area of responsibility (deduction \/ calculation \/ sections)<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong><strong>0<\/strong><\/strong><\/strong>,12<\/strong><\/td><td>The zone is fixed at the initial stage of the project. The level is assessed by the population: inferences performed, computational experiments, sections, checks (confirmed by the workbook\/repository). Full volume qualitatively \u2192 100\u00a0%; mainly (minor gaps) \u2192 80\u00a0%; partially \u2192 60\u00a0%; fragmentary \u2192 40\u00a0%; minimum \u2192 20\u00a0%; \u2192 0 % not performed.<\/td><\/tr><tr><td><strong>B2<\/strong><\/td><td>Fulfillment of obligations and risk communication<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong><strong>0<\/strong>,0<\/strong><\/strong>8<\/strong><\/td><td>The total percentage of criterion fulfillment = the percentage of tasks taken that are EITHER completed within the agreed time frame, OR for which the risk\/delay in advance (before the deadline) is communicated with the update of the record and the new date (0-100%). Silent failure of the deadline \u2013 not counted (0\u00a0%).<\/td><\/tr><tr><td><strong>B3<\/strong><\/td><td>Effectiveness of mutual verification of solutions<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong><strong>0<\/strong>,0<\/strong><\/strong>5<\/strong><\/td><td>Only effective reviews are credited (checked the solutionof a colleague \u2192 found an error or suggested a significant improvement, the \u2192 author responded with a \u2192 verified correction). \u22653 effective \u2192 100%; 2 \u2192 80%; 1 \u2192 50%; \u2192 0\u00a00%. <\/td><\/tr><tr><td colspan=\"4\"><strong>C. Mathematical quality (TEAM \u2013 the same for all)<\/strong><\/td><\/tr><tr><td><strong>C1<\/strong><\/td><td>Correctness of results (reference set)<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong><strong>0<\/strong><\/strong><\/strong>,12<\/strong><\/td><td>The total percentage of criterion fulfillment = tasks\/cases with a result that coincides with the reference\/analytical solution within the given error \/ total number of cases \u00d7 100\u00a0%.<\/td><\/tr><tr><td><strong>C2<\/strong><\/td><td>Rigor of justification<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong><strong>0<\/strong>,0<\/strong><\/strong>6<\/strong><\/td><td>20 %\u00a0for each item: 1) all inference steps are given; 2) named theorems\/methods with conditions; 3) conditions of applicability of the method are checked; 4) error\/convergence assessment is given; 5) verification of dimensions\/limiting cases.<\/td><\/tr><tr><td><strong>C3<\/strong><\/td><td>Adequacy of selected mathematical methods and models<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong><strong>0<\/strong>,0<\/strong><\/strong>5<\/strong><\/td><td>25 %\u00a0for each item: 1) assumptions are explicitly written out; 2) verification on a known individual case; 3) analysis of sensitivity to parameters; 4) comparison with an alternative method\/source.<\/td><\/tr><tr><td><strong>C4<\/strong><\/td><td>Numerical correctness and stability<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong><strong>0<\/strong>,0<\/strong><\/strong>4<\/strong><\/td><td>25 %\u00a0for each item: 1) processing of extreme  cases (division by zero, poor conditioning); 2) control of rounding error; 3) numerically confirmed convergence; 4) reproducibility (fixed data\/seed).<\/td><\/tr><tr><td><strong>C-5<\/strong><\/td><td>Notation and reproducibility of design<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong><strong>0<\/strong>,0<\/strong><\/strong>3<\/strong><\/td><td>33 %\u00a0for each item: 1) correct and consistent mathematical notation; 2) all designations are defined; 3) reproducible script\/calculation layouts are provided.<\/td><\/tr><tr><td colspan=\"4\"><strong>D. Complexity of the area of responsibility (individual)<\/strong><\/td><\/tr><tr><td><strong>D1<\/strong><\/td><td>Complexity and completeness of the individual area of responsibility<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong><strong>0<\/strong><\/strong><\/strong>,1<\/strong><\/td><td>The zone is fixed at the initial stage (for individual projects \u2013 the entire project). The total percentage of criterion fulfillment = difficulty level \u00d7 completeness of fulfillment. Difficulty levels: expert (non-standard proof, research\/optimization task) \u2192 1.0; advanced \u2192 0.9; basic \u2192 0.8.Completeness: fully \u2192 100%, partially\/simplified \u2192 depending on the percentage of work performed (30-80%); trivial contribution \u2192 20%; not completed \u2192 0%. <\/td><\/tr><tr><td colspan=\"4\"><strong>E. Protection and understanding (individual)<\/strong><\/td><\/tr><tr><td><strong>E1<\/strong><\/td><td>Answers to an open bank of theoretical questions<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong><strong>0<\/strong><\/strong><\/strong>,12<\/strong><\/td><td>The applicant receives <em>K<\/em> questions on the published set. Each answer: full \u2192 100\u00a0%, partial \u2192 50\u00a0%, no \u2192 0\u00a0%.<br>The total percentage of the criterion fulfillment = the sum of the percentages for the answers \/ <em>K<\/em>.<\/td><\/tr><tr><td><strong>E2<\/strong><\/td><td>Solvinga modified problem \"on the fly\"<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong><strong>0<\/strong>,0<\/strong><\/strong>5<\/strong><\/td><td>Two pre-prepared microchanges of parameters\/conditions. Each solved\/explained \u2192 50%; partially solved or with errors \u2192 25\u00a0%; not solved \u2192 0\u00a0%. The total percentage of the criterion fulfillment = the sum of the percentages for the responses.<\/td><\/tr><tr><td><strong>E3)<\/strong><\/td><td>Demonstration of calculation reproducibility<\/td><td class=\"has-text-align-center\" data-align=\"center\"><strong><strong><strong><strong>0<\/strong>,0<\/strong><\/strong>3<\/strong><\/td><td>Recalculation: from scratch reproduces the result \u2192 100%; partially \u2192 50%; no \u2192 0%.<\/td><\/tr><tr><td colspan=\"2\"><strong>\u0420\u0410\u0417\u041e\u041c (sum of weights)<\/strong><\/td><td><strong>1,00<\/strong><\/td><td class=\"has-text-align-center\" data-align=\"center\"><\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">4.3. Mechanics of data collection<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">To ensure theobjectivity ofthe assessment, confirmation of the results by the actual development artifacts and systematic monitoring of progress during the semester, four main stages are used:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Initial stage of the project. The applicant fixes the work plan and determines the personal area of responsibility in the team, indicating its level of complexity (basic, advanced or expert). For example: development of API and authorization module; configuration of persistence level and migrations; implementation of asynchronous handlers and caching.The developed terms of reference serve as a basis for further assessment of the quality of the process and the complexity of the individual contribution.<\/li>\n\n\n\n<li>Intermediate control points (Checkpoints). During the semester, three control points are provided (for example, at the 2nd, 5th and 8th weeks). The current results of the development and the quality of the organization of the process are subject to assessment. All detected comments are recorded as issues and are subject to mandatory elimination until the next stage, which makes it possible to measure the dynamics of correcting deficiencies.<\/li>\n\n\n\n<li>Open Question Bank: A list of questions on the relevant topics is published in advance. Project protection is carried out individually for each applicant and covers both the processing of his individual area of responsibility and an understanding of the overall architecture of the product. Completeness of responses is assessed against a clear checklist (complete, partial, or missing), making protection the primary verification tool for real-world contributions.<\/li>\n\n\n\n<li>Anonymous peer-review as an indicator of anomalies. The results of mutual evaluation by team members do not automatically change the final score. In case of significant discrepancies between the assessments of team members, the teacher conducts an additional individual check. <\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\">\n<li><\/li>\n<\/ol>\n\n\n\n<h3 class=\"wp-block-heading\">4.4. Example: one team \u2013 different semester grades<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The team made a good product, so the team component is the same for everyone: C = 27% (out of 30%). <br><span style=\"text-decoration: underline;\"><em>Applicant A<\/em><\/span> (actively working):<br>A = 14%, B = 23%, D = 9%, E = 18% \u2192 in total 64%.<br>The final percentage of project implementation by the applicant is 27% + 64% = 91%.<br><span style=\"text-decoration: underline;\"><em><span style=\"text-decoration: underline;\">Applicant <\/span>B<\/em><\/span> (worked less):<br>A = 12%, B = 14%, D = 7%, E = 16% for a \u2192 total of 49%.<br>The final percentage of project implementation by the applicant is 27% + 49% = 76%. <br><span style=\"text-decoration: underline;\"><em><span style=\"text-decoration: underline;\">Applicant <\/span>V<\/em><\/span> (almost \u201cpassenger\u201d):<br>A = 5%, B = 4%, D = 3%, E = 8% for a \u2192 total of 20%.<br>The final percentage of project implementation by the applicant is 27% + 20% = 47%. <br>This is BELOW the 60% threshold, so the draft is not drawn up. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">As a result: <strong>one product, one team \u2013 but different ratings. <\/strong>The project is not saved by either a joint product or laboratory, if personal participation in the project is below the threshold.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">5. Principles of evaluation of individual and other stem projects<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The principles of evaluation are adapted depending on the format and scale of the project, but the basic criterion is always the measurability of the results in accordance with the approved Terms of Reference (ToR).<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Individual stem projects: Evaluation is carried out according to a table of criteria developed for team projects, provided that the team consists of one participant. In this case, the applicant assumes full responsibility for the entire development life cycle. Accordingly, the individual and \"team\" (product) components are combined, and 100% of the final score is formed solely on the basis of the personal result of the applicant.<\/li>\n\n\n\n<li>Multicomponent stem projects. If the project covers several academic disciplines (educational components), the assessment is carried out in a differentiated manner for each of them. Each discipline assesses separately, based on the degree of achievement of those competencies and the fulfillment of those functional requirements that were clearly assigned to this component in the joint terms of reference.This allows you to enroll one large-scale project as a result of studying several subjects at once without \"double\" scoring for the same work.<\/li>\n\n\n\n<li>Interdepartmental and intersectoral stem projects. Projects with a high level of integration are subject to separate assessment by experts of each involved department or industry. Points are awarded independently, based on the fulfillment of the specific requirements of each subject area prescribed in the ToR.Protection of such projects can take place in the format of joint intersectoral commissions or through successive defenses in the relevant departments, which provides an objective professional assessment of the applicant's cross-functional skills.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Annex A. Recommendations for the assessment of laboratory and homework<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Laboratory and homework is a mandatory INDIVIDUAL component of the semester assessment. Their purpose is to check the completeness of the acquisition of competencies by each applicant. The work is assessed not on the principle of \"handed over \/ not handed over\", but in aggregate:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>75% \u2013 correctness of execution<\/li>\n\n\n\n<li>25% \u2013 short individual protection (2\u20133 minutes of oral questions).<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Protection inherits AI policy: <strong>if the applicant<\/strong> <strong>cannot explain its own result, the \"correctness\" part is not counted<\/strong>. Protection can be carried out selectively (some applicants per pair).<br>Each work has a \"raw\" weight in complexity, and its performance is estimated as a percentage. The result is normalized, so the number of works and their complexity can be any:<\/p>\n\n\n\n<div class=\"wp-block-math\"><math display=\"block\"><semantics><mrow><mi>L<\/mi><mo>=<\/mo><msub><mi>L<\/mi><mrow><mi>m<\/mi><mi>a<\/mi><mi>x<\/mi><\/mrow><\/msub><mo>\u00d7<\/mo><mfrac><mrow><msubsup><mo movablelimits=\"false\">\u2211<\/mo><mrow><mi>i<\/mi><mo>=<\/mo><mn>1<\/mn><\/mrow><mi>n<\/mi><\/msubsup><msub><mi>w<\/mi><mi>i<\/mi><\/msub><mo>\u22c5<\/mo><msub><mi>s<\/mi><mi>i<\/mi><\/msub><\/mrow><mrow><msubsup><mo movablelimits=\"false\">\u2211<\/mo><mrow><mi>i<\/mi><mo>=<\/mo><mn>1<\/mn><\/mrow><mi>n<\/mi><\/msubsup><msub><mi>w<\/mi><mi>i<\/mi><\/msub><mo>\u22c5<\/mo><mn>100<\/mn><mi>%<\/mi><\/mrow><\/mfrac><\/mrow><annotation encoding=\"application\/x-tex\">L = L_{max} \u00d7 \\frac{\\sum_{i=1}^n w_i \\cdot s_i}{\\sum_{i=1}^n w_i \\cdot 100\\%}\n<\/annotation><\/semantics><\/math><\/div>\n\n\n\n<p class=\"wp-block-paragraph\">Wherein <math data-latex=\"L\"><semantics><mi>L<\/mi><annotation encoding=\"application\/x-tex\">L<\/annotation><\/semantics><\/math> \u2013 final assessment for all laboratory and homework; <math data-latex=\"L_{max}\"><semantics><msub><mi>L<\/mi><mrow><mi>m<\/mi><mi>a<\/mi><mi>x<\/mi><\/mrow><\/msub><annotation encoding=\"application\/x-tex\">L,MAX<\/annotation><\/semantics><\/math> \u2013 the maximum possible final assessment; <math data-latex=\"w_i \"><semantics><msub><mi>w<\/mi><mi>i<\/mi><\/msub><annotation encoding=\"application\/x-tex\">W + I <\/annotation><\/semantics><\/math> \u2013 work complexity weight coefficient (simple \u2248 5, average \u2248 8, complex \u2248 12); <math data-latex=\"s_i\"><semantics><msub><mi>s<\/mi><mi>i<\/mi><\/msub><annotation encoding=\"application\/x-tex\">% S (*% I)<\/annotation><\/semantics><\/math> \u2013 evaluation of work as a percentage (0\u2013100%); n \u2013 total number of works (up to 12); i \u2013 number of current work, <math data-latex=\"i \\in \\overset{\\rule{1.5em}{0.4pt}}{{1,n}}\"><semantics><mrow><mi>i<\/mi><mo>\u2208<\/mo><mrow><mover><mrow><mn>1<\/mn><mo separator=\"true\">,<\/mo><mi>n<\/mi><\/mrow><mspace width=\"2.1429em\" height=\"0.3985pt\" mathbackground=\"black\"><\/mspace><\/mover><\/mrow><\/mrow><annotation encoding=\"application\/x-tex\">i \\in \\overset{\\rule{1.5em}{0.4pt}}{{1,n}}<\/annotation><\/semantics><\/math>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>","protected":false},"excerpt":{"rendered":"<p>Approved at the meeting of the Department of Software Systems and Technologies Minutes No. 16 dated May 01, 2026 1. Purpose and principles According to the Concept for the Development of Natural and Mathematical Education, approved by\u2026<\/p>","protected":false},"author":1,"featured_media":0,"parent":3500,"menu_order":3,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-9170","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/pst.knu.ua\/en\/wp-json\/wp\/v2\/pages\/9170","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pst.knu.ua\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/pst.knu.ua\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/pst.knu.ua\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/pst.knu.ua\/en\/wp-json\/wp\/v2\/comments?post=9170"}],"version-history":[{"count":84,"href":"https:\/\/pst.knu.ua\/en\/wp-json\/wp\/v2\/pages\/9170\/revisions"}],"predecessor-version":[{"id":9262,"href":"https:\/\/pst.knu.ua\/en\/wp-json\/wp\/v2\/pages\/9170\/revisions\/9262"}],"up":[{"embeddable":true,"href":"https:\/\/pst.knu.ua\/en\/wp-json\/wp\/v2\/pages\/3500"}],"wp:attachment":[{"href":"https:\/\/pst.knu.ua\/en\/wp-json\/wp\/v2\/media?parent=9170"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}