AIP-210 CertNexus Certified Artificial Intelligence Practitioner (CAIP) Questions and Answers

Completeness is a quality criterion that describes the degree to which all required measures are known. Completeness can help assess the coverage and availability of data for a given purpose or analysis. Completeness can be measured by comparing the actual number of measures with the expected number of measures, or by identifying and counting any missing, null, or unknown values in the data.

Latency is the time delay between a request and a response. Latency can affect the performance and user experience of an application, especially when real-time or near-real-time responses are required. Deploying a deep learning model as an embedded model on edge devices can reduce latency, as the model can run locally on the device without relying on network connectivity or cloud servers. Edge devices are devices that are located at the edge of a network, such as smartphones, tablets, laptops, sensors, cameras, or drones.

Principal component analysis (PCA) is a technique that reduces the dimensionality of a dataset by transforming it into a set of new variables called principal components. The principal components are linear combinations of the original variables that capture the maximum amount of variance in the data. The first principal component explains the most variance, the second principal component explains the second most variance, and so on. The goal of PCA is to retain as much variance as possible while reducing the number of variables.

A type 1 error in statistical hypothesis testing is when the null hypothesis is true, but is rejected. This means that the test falsely concludes that there is a significant difference or effect when there is none. The probability of making a type 1 error is denoted by alpha, which is also known as the significance level of the test. A type 1 error can be reduced by choosing a smaller alpha value, but this may increase the chance of making a type 2 error, which is when the null hypothesis is false but fails to be rejected. References: [Type I and type II errors - Wikipedia], [Type I Error and Type II Error - Statistics How To]

 Transparency is an ethical principle that describes the degree to which an AI system can provide clear and understandable information about its inputs, outputs, processes, and decisions. Transparency can help increase trust and confidence among users and stakeholders, as well as enable accountability and responsibility for the system’s actions and outcomes. Logging and storing historical predictions for potential, future access requests is an example of transparency, as it can help provide evidence and explanation for the system’s recommendations, as well as facilitate auditing and feedback.

This SQL query provides the Directors’ Firstname, Lastname, the name of their departments, and the average employee’s salary by joining the three tables using the appropriate join types and conditions. The RIGHT JOIN between Employee_Table and Department_Table ensures that all departments are included in the result, even if they have no employees. The INNER JOIN between Department_Table and Directorjable ensures that only departments with directors are included in the result. The GROUP BY clause groups the result by the directors’ names and departments’ names, and calculates the average salary for each group using the AVG function. References: SQL Joins - W3Schools, SQL GROUP BY Statement - W3Schools

Anomaly detection is an unsupervised learning technique that identifies outliers or abnormal patterns in data, which can be useful for fraud detection. Anomaly detection algorithms can learn the normal behavior of transactions and flag the ones that deviate significantly from the norm, indicating possible fraud.

A false negative is an error where a positive case (belonging to the target class) is incorrectly predicted as negative (not belonging to the target class). A false negative rate is the ratio of false negatives to all actual positive cases. A low false negative rate means that most of the positive cases are correctly identified by the classifier.

For a diagnostic tool that can diagnose a particular disease so that individuals with the disease can receive treatment, it is of primary importance that it has a low false negative rate. This is because false negatives can have serious consequences for patients who have the disease but do not receive treatment, such as increased risk of mortality or complications. A low false negative rate can ensure that most patients who have the disease are diagnosed correctly and receive timely treatment.

Federated learning is a distributed approach to machine learning that allows multiple parties to collaboratively train a model without sharing their data with each other or a central server. This protects the privacy of the user’s data while still enabling well-trained models that can benefit from diverse and large-scale datasets. References: [Federated Learning - Wikipedia], [Federated Learning for Mobile Keyboard Prediction - Google AI Blog]

Word2vec is a word embedding method that finds characteristics of words in a very large number of documents. Word embedding is a technique that converts words into numerical vectors that represent their meaning, usage, or context. Word2vec learns a dense and continuous vector representation for each word based on its context in a large corpus of text. Word2vec can capture the semantic and syntactic similarity and relationships among words, such as synonyms, antonyms, analogies, or associations1.

Technical debt is a metaphor that describes the implied cost of additional work or rework caused by choosing an easy or quick solution over a better but more complex solution. Technical debt can accumulate in ML systems due to various factors, such as changing requirements, outdated code, poor documentation, or lack of testing. Some of the ways to decrease technical debt in ML systems are:

• Documentation readability: Documentation readability refers to how easy it is to understand and use the documentation of an ML system. Documentation readability can help reduce technical debt by providing clear and consistent information about the system’s design, functionality, performance, and maintenance. Documentation readability can also facilitate communication and collaboration among different stakeholders, such as developers, testers, users, and managers.
• Refactoring: Refactoring is the process of improving the structure and quality of code without changing its functionality. Refactoring can help reduce technical debt by eliminating code smells, such as duplication, complexity, or inconsistency. Refactoring can also enhance the readability, maintainability, and extensibility of code.

Before log-transforming Y, we should add 1 to all of the Y values. This is because log transformation is undefined for zero or negative values, and some of the Y values may be zero. Adding 1 to all of the Y values can avoid this problem and ensure that the log transformation is valid and meaningful. Adding 1 to all of the Y values is also known as a log-plus-one transformation.

Semi-supervised learning is an approach that is best if a limited portion of your training data is labeled. Semi-supervised learning is a type of machine learning that uses both labeled and unlabeled data to train a model. Semi-supervised learning can leverage the large amount of unlabeled data that is easier and cheaper to obtain and use it to improve the model’s performance. Semi-supervised learning can use various techniques, such as self-training, co-training, or generative models, to incorporate unlabeled data into the learning process.

Logit-transformation is a common way to transform proportion data into a continuous variable that can be used for linear regression. However, one concern with this approach is that noisy data could become more influential in your model. This is because logit-transformation tends to amplify the values close to 0 and 1, which are also the values that are likely to be affected by measurement errors or outliers. This could distort the relationship between the dependent and independent variables and bias the regression coefficients. References: [Logit Transformation | Real Statistics Using Excel], [Logit transformation for proportions - Cross Validated]

Normalization is a method that can help us to solve the problem of features being on different scales when using the k-nearest neighbors algorithm. Normalization is a technique that rescales the values of features to a common range, such as [0, 1] or [-1, 1]. Normalization can help reduce the influence or dominance of some features over others, as well as improve the accuracy and performance of the algorithm2.

Workflow design patterns for machine learning pipelines are common solutions to recurring problems in building and managing machine learning workflows. One of these patterns is to represent a pipeline with a directed acyclic graph (DAG), which is a graph that consists of nodes and edges, where each node represents a step or task in the pipeline, and each edge represents a dependency or order between the tasks. A DAG has no cycles, meaning there is no way to start at one node and return to it by following the edges. A DAG can help visualize and organize the pipeline, as well as facilitate parallel execution, fault tolerance, and reproducibility.

Emergent bias is a type of bias that arises when an AI model encounters new or different data or scenarios that were not present or accounted for during its training or development. Emergent bias can cause the model to make inaccurate or unfair predictions or decisions, as it may not be able to generalize well to new situations or adapt to changing conditions. One possible cause of emergent bias is seasonality, which means that some variables or patterns in the data may vary depending on the time of year. For example, if an AI model for merchandise sales prediction was trained in winter and applied in summer, it may produce biased results due to differences in customer behavior, demand, or preferences.

Precision and recall are two measures that can evaluate the performance of a classifier, especially when the data is imbalanced. Precision is the ratio of true positives (correctly predicted positive cases) to all predicted positive cases. Recall is the ratio of true positives to all actual positive cases. Precision and recall can help assess how well the classifier can identify the positive cases (the disease) and avoid false negatives (missed diagnosis) or false positives (unnecessary treatment).

Video tracking is a technique that involves detecting and following moving objects in a video sequence. Video tracking can be used for various applications, such as surveillance, security, sports analysis, and human-computer interaction. One typical use case of video tracking is traffic monitoring, where video tracking can help measure traffic flow, detect congestion, identify violations, and optimize traffic signals.

Stratification is not a valid cross-validation method, but a technique to ensure that each subset of data has the same proportion of classes or labels as the original data. Stratification can be used in conjunction with cross-validation methods such as k-fold or leave-one-out to preserve the class distribution and reduce bias or variance in the validation results. Bootstrapping, k-fold, and leave-one-out are all valid cross-validation methods that use different ways of splitting and resampling the data to estimate the performance of a machine learning model.

To calculate the minimum grade needed to achieve an 80% average, we can use the following formula:

minimum grade = (target average * number of tests - sum of grades) / (number of tests - 1)

Plugging in the given values, we get:

minimum grade = (80 * 7 - (76 + 81 + 78 + 87 + 75 + 72)) / (7 - 6)

minimum grade = (560 - 469) / 1

minimum grade = 91

Therefore, the student needs to score at least 91 on the last test to get an 80% average.

The Adversarial ML Threat Matrix is an open framework designed to help detect, respond to, and remediate threats in ML systems. The Adversarial ML Threat Matrix is inspired by the MITRE ATT&CK® Matrix1, which is a framework for describing cyberattacks across various stages of an attack lifecycle. The Adversarial ML Threat Matrix adapts this framework to address specific threats and vulnerabilities in ML systems, such as data poisoning, model stealing, model evasion, or model inversion2. The Adversarial ML Threat Matrix provides a structured way to organize and classify adversarial techniques, tactics, procedures, examples, and mitigations for ML systems2.

An L1 norm is a measure of distance or magnitude that is defined as the sum of the absolute values of the components of a vector. For example, if x and y are two components of a vector, then the L1 norm of that vector is |x| + |y|. The L1 norm is also known as the Manhattan distance or the taxicab distance, as it represents the shortest path between two points in a grid-like city.

When concept drift is detected in the pipeline, it means that the model performance has degraded over time due to changes in the underlying data generating process. This requires retraining the model with new data that reflects the current situation and updating the model parameters accordingly. References: Use pipeline parameters to retrain models in the designer - Azure Machine Learning | Microsoft Learn, Retraining Model During Deployment: Continuous Training and Continuous Testing