New Microsoft Word Document (2)
New Microsoft Word Document (2)
INTRODUCTION
INTELLIGENCE ARTIFICIAL INTELLIGENCE
It is a natural process. It is programmed by humans.
It is actually hereditary. It is not hereditary.
Knowledge is required for intelligence. KB and electricity are required to
generate output.
No human is an expert. We may get Expert systems are made which
better solutions from other humans. aggregate many person’s experience and
ideas.
DEFINITION
The study of how to make computers do things at which at the moment, people are
better.
“Artificial Intelligence is the ability of a computer to act like a human being”.
(b) Artificial Intelligence - Study and construction of agent programs that perform well in
a given environment, for a given agent architecture.
(c) Agent - An entity that takes action in response to precepts from an environment.
(d) Rationality - property of a system which does the “right thing” given what it knows.
(e) Logical Reasoning - A process of deriving new sentences from old, such that the new
sentences are necessarily true if the old ones are true.
Figure 1.1 Some definitions of artificial intelligence, organized into four categories
DEFINITION OF ARTIFICIAL INTELLEGENCE
In today's world, technology is growing very fast, and we are getting in touch with different
new technologies day by day.
Here, one of the booming technologies of computer science is Artificial Intelligence which is
ready to create a new revolution in the world by making intelligent machines.The Artificial
Intelligence is now all around us. It is currently working with a variety of subfields, ranging from
general to specific, such as self-driving cars, playing chess, proving theorems, playing music,
Painting, etc.
AI is one of the fascinating and universal fields of Computer science which has a great scope in
future. AI holds a tendency to cause a machine to work as a human.
Artificial Intelligence is composed of two words Artificial and Intelligence, where Artificial
defines "man- made," and intelligence defines "thinking power", hence AI means "a man-made
thinking power."
"It is a branch of computer science by which we can create intelligent machines which can behave
like a human, think like humans, and able to make decisions."
Artificial Intelligence exists when a machine can have human based skills such as learning,
reasoning, and solving problems
With Artificial Intelligence you do not need to preprogram a machine to do some work, despite
that you can create a machine with programmed algorithms which can work with own
intelligence, and that is the awesomeness of AI.
It is believed that AI is not a new technology, and some people says that as per Greek myth, there
were Mechanical men in early days which can work and behave like humans.
What is AI?
AI stands for Artificial Intelligence, which is a field of study that focuses on creating computer
systems that can performtasks that normally require human intelligence.
Narrow AI (Weak AI) – Designed for specific tasks (e.g., Siri, Google Assistant,
ChatGPT).
General AI (Strong AI) – Aims to perform any intellectual task a human can (still
theoretical).
Super AI – Hypothetical AI surpassing human intelligence.
Artificial intelligence can be organized in several ways, depending on stages of
development or actions being performed.
For instance, four stages of AI development are commonly recognized.
1. Reactive machines: Limited AI that only reacts to different kinds of stimuli based on
preprogrammed rules. Does not use memory and thus cannot learn with new data. IBM’s
Deep Blue that beat chess champion Garry Kasparov in 1997 was an example of a
reactive machine.
2. Limited memory: Most modern AI is considered to be limited memory. It can use
memory to improve over time by being trained with new data, typically through an
artificial neural network or other training model. Deep learning, a subset of machine
learning, is considered limited memory artificial intelligence.
3. Theory of mind: Theory of mind AI does not currently exist, but research is ongoing into
its possibilities. It describes AI that can emulate the human mind and has decision-
making capabilities equal to that of a human, including recognizing and remembering
emotions and reacting in social situations as a human would.
4. Self aware: A step above theory of mind AI, self-aware AI describes a mythical machine
that is aware of its own existence and has the intellectual and emotional capabilities of a
human. Like theory of mind AI, self-aware AI does not currently exist.
A more useful way of broadly categorizing types of artificial intelligence is by what the
machine can do. All of what we currently call artificial intelligence is considered artificial
“narrow” intelligence, in that it can perform only narrow sets of actions based on its
programming and training. For instance, an AI algorithm that is used for object
classification won’t be able to perform natural language processing. Google Search is a
form of narrow AI, as is predictive analytics, or virtual assistants.
Artificial general intelligence (AGI) would be the ability for a machine to “sense, think,
and act” just like a human. AGI does not currently exist. The next level would be
artificial superintelligence (ASI), in which the machine would be able to function in all
ways superior to a human.
AI Technologies:
Machine Learning (ML) – AI learns from data to improve over time.
Deep Learning – Uses neural networks to process complex patterns.
Natural Language Processing (NLP) – Enables AI to understand human language (e.g.,
chatbots).
Computer Vision – Helps AI interpret and analyze images/videos.
Robotics – AI-powered robots perform tasks like manufacturing and self-driving.
Applications and use cases for artificial intelligence”
Speech recognition
Automatically convert spoken speech into written text.
Image recognition
Identify and categorize various aspects of an image.
Translation
Translate written or spoken words from one language into another.
Predictive modeling
Mine data to forecast specific outcomes with high degrees of granularity.
Data analytics
Find patterns and relationships in data for business intelligence.
Cybersecurity
Autonomously scan networks for cyber attacks and threats.
Before Learning about Artificial Intelligence, we should know that what is the
importance of AI and
why should we learn it. Following are some main reasons to learn about AI:
o With the help of AI, you can create such software or devices which can solve real-
world problems very easily and with accuracy such as health issues, marketing, traffic
issues, etc.
o With the help of AI, you can create your personal virtual Assistant, such as Cortana,
Google Assistant, Siri, etc.
o With the help of AI, you can build such Robots which can work in an environment
where survival of humans can be at risk.
o AI opens a path for other new technologies, new devices, and new Opportunities.
Artificial Intelligence is not just a part of computer science even it's so vast and
requires lots of other factors which can contribute to it. To create the AI first we should
know that how intelligence is composed, so the Intelligence is an intangible part of our
brain which is a combination of Reasoning, learning, problem- solving perception,
language understanding, etc.
To achieve the above factors for a machine or software Artificial Intelligence requires
the following discipline:
o Mathematics
o Biology
o Psychology
o Sociology
o Computer Science
o Neurons Study
o Statistics
o High Accuracy with less errors: AI machines or systems are prone to less errors
and high accuracy as it takes decisions as per pre-experience or information.
o High-Speed: AI systems can be of very high-speed and fast-decision making,
because of that AI systems can beat a chess champion in the Chess game.
o High reliability: AI machines are highly reliable and can perform the same action
multiple times with high accuracy.
o Useful for risky areas: AI machines can be helpful in situations such as defusing
a bomb, exploring the ocean floor, where to employ a human can be risky.
o Digital Assistant: AI can be very useful to provide digital assistant to the users
such as AI technology is currently used by various E-commerce websites to show
the products as per customer requirement.
o Useful as a public utility: AI can be very useful for public utilities such as a self-
driving car which can make our journey safer and hassle-free, facial recognition
for security purpose, Natural language processing to communicate with the human
in human-language, etc.
Every technology has some disadvantages, and thesame goes for Artificial
intelligence. Being so advantageous technology still, it has some disadvantages
which we need to keep in our mind while creating an AI system. Following are the
disadvantages of AI:
Before learning about Artificial Intelligence, you must have the fundamental
knowledge of following so that you can understand the concepts easily:
o Any computer language such as C, C++, Java, Python, etc.(knowledge of Python will
be an advantage)
o Knowledge of essential Mathematics such as derivatives, probability theory, etc.
AI maturation: 1957-1979
The time between when the phrase “artificial intelligence” was created, and the 1980s
was a period of both rapid growth and struggle for AI research. The late 1950s through
the 1960s was a time of creation. From programming languages that are still in use to
this day to books and films that explored the idea of robots, AI became a mainstream
idea quickly.
The 1970s showed similar improvements, such as the first anthropomorphic robot
being built in Japan, to the first example of an autonomous vehicle being built by an
engineering grad student. However, it was also a time of struggle for AI research, as the
U.S. government showed little interest in continuing to fund AI research.
1980: The first expert system came into the commercial market, known as XCON
(expert configurer). It was designed to assist in the ordering of computer systems by
automatically picking components based on the customer’s needs.
1981: The Japanese government allocated $850 million (over $2 billion dollars in
today’s money) to the Fifth Generation Computer project. Their aim was to create
computers that could translate, converse in human language, and express reasoning on a
human level.
1984: The AAAI warns of an incoming “AI Winter” where funding and interest
would decrease, and make research significantly more difficult.
1985: An autonomous drawing program known as AARON is demonstrated at the
AAAI conference.
1986: Ernst Dickmann and his team at Bundeswehr University of Munich created
and demonstrated the first driverless car (or robot car). It could drive up to 55 mph on
roads that didn’t have other obstacles or human drivers.
1987: Commercial launch of Alacrity by Alactrious Inc. Alacrity was the first
strategy managerial advisory system, and used a complex expert system with 3,000+
rules.
AI winter: 1987-1993
As the AAAI warned, an AI Winter came. The term describes a period of low
consumer, public, and private interest in AI which leads to decreased research funding,
which, in turn, leads to few breakthroughs. Both private investors and the government
lost interest in AI and halted their funding due to high cost versus seemingly low return.
This AI Winter came about because of some setbacks in the machine market and expert
systems, including the end of the Fifth Generation project, cutbacks in strategic
computing initiatives, and a slowdown in the deployment of expert systems.
Notable dates include:
1987: The market for specialized LISP-based hardware collapsed due to cheaper
and more accessible competitors that could run LISP software, including those offered
by IBM and Apple. This caused many specialized LISP companies to fail as the
technology was now easily accessible.
1988: A computer programmer named Rollo Carpenter invented the chatbot
Jabberwacky, which he programmed to provide interesting and entertaining
conversation to humans.
AI agents: 1993-2011
Despite the lack of funding during the AI Winter, the early 90s showed some
impressive strides forward in AI research, including the introduction of the first AI
system that could beat a reigning world champion chess player. This era also introduced
AI into everyday life via innovations such as the first Roomba and the first
commercially-available speech recognition software on Windows computers.
The surge in interest was followed by a surge in funding for research, which allowed
even more progress to be made.
Notable dates include:
1997: Deep Blue (developed by IBM) beat the world chess champion, Gary
Kasparov, in a highly-publicized match, becoming the first program to beat a human
chess champion.
1997: Windows released a speech recognition software (developed by Dragon
Systems).
2000: Professor Cynthia Breazeal developed the first robot that could simulate
human emotions with its face,which included eyes, eyebrows, ears, and a mouth. It was
called Kismet.
2002: The first Roomba was released.
2003: Nasa landed two rovers onto Mars (Spirit and Opportunity) and they
navigated the surface of the planet without human intervention.
2006: Companies such as Twitter, Facebook, and Netflix started utilizing AI as a
part of their advertising and user experience (UX) algorithms.
2010: Microsoft launched the Xbox 360 Kinect, the first gaming hardware designed
to track body movement and translate it into gaming directions.
2011: An NLP computer programmed to answer questions named Watson (created
by IBM) won Jeopardy against two former champions in a televised game.
2011: Apple released Siri, the first popular virtual assistant.
Artificial General Intelligence: 2012-present
That brings us to the most recent developments in AI, up to the present day. We’ve
seen a surge in common-use AI tools, such as virtual assistants, search engines, etc. This
time period also popularized Deep Learning and Big Data..
Notable dates include:
2012: Two researchers from Google (Jeff Dean and Andrew Ng) trained a neural
network to recognize cats by showing it unlabeled images and no background
information.
2015: Elon Musk, Stephen Hawking, and Steve Wozniak (and over 3,000 others)
signed an open letter to the worlds’ government systems banning the development of
(and later, use of) autonomous weapons for purposes of war.
2016: Hanson Robotics created a humanoid robot named Sophia, who became
known as the first “robot citizen” and was the first robot created with a realistic human
appearance and the ability to see and replicate emotions, as well as to communicate.
2017: Facebook programmed two AI chatbots to converse and learn how to
negotiate, but as they went back and forth they ended up forgoing English and
developing their own language, completely autonomously.
2018: A Chinese tech group called Alibaba’s language-processing AI beat human
intellect on a Stanford reading and comprehension test.
2019: Google’s AlphaStar reached Grandmaster on the video game StarCraft 2,
outperforming all but 0.2% of human players.
2020: OpenAI started beta testing GPT-3, a model that uses Deep Learning to
create code, poetry, and other such language and writing tasks. While not the first of its
kind, it is the first that creates content almost indistinguishable from those created by
humans.
2021: OpenAI developed DALL-E, which can process and understand images
enough to produce accurate captions, moving AI one step closer to understanding the
visual world.
The Turing Test, proposed by Alan Turing (1950), was designed to provide a
satisfactory operational definition of intelligence. A computer passes the test if a
human interrogator, after posing some written questions, cannot tell whether the
written responses come from a person or from a computer.
computer vision to perceive objects, and robotics to manipulate objects and move
about.
Thinking humanly: The cognitive modelling approach
Analyse how a given program thinks like a human, we must have some way of
determining how humans think. The interdisciplinary field of cognitive science
brings together computer models from AI and experimental techniques from
psychology to try to construct precise and testable theories of the workings of the
human mind.
The Greek philosopher Aristotle was one of the first to attempt to codify ``right
thinking,'' that is, irrefutable reasoning processes. His famous syllogisms provided
patterns for argument structures that always gave correct conclusions given correct
premises.
For example, ``Socrates is a man; all men are mortal; therefore Socrates is mortal.''
These laws of thought were supposed to govern the operation of the mind, and
initiated the field of logic.
Acting rationally means acting so as to achieve one's goals, given one's beliefs. An
agent is just something that perceives and acts.
The right thing: that which is expected to maximize goal achievement, given the
available information
For Example - blinking reflex- but should be in the service of rational action.
THE STATE OF THE ART:
Artificial Intelligence (AI) is an interdisciplinary field drawing from several core disciplines, including
computer science, economics, psychology, neuroscience, mathematics, linguistics, philosophy,
control theory, and cybernetics. Each of these areas contributes uniquely to the development and
advancement of AI.
Key Developments:
Deep Learning & Neural Networks – AI models like GPT-4, DALL·E, and AlphaFold rely on deep
learning techniques.
Quantum Computing & AI – Emerging research on quantum-enhanced machine learning.
AI & Edge Computing – AI processing on edge devices for real-time decision-making.
Applications:
Autonomous systems (self-driving cars, drones).
AI-powered cybersecurity (threat detection & prevention).
AI-driven software development (Copilot, AlphaCode).
2. Economics & AI
AI is transforming economics through market predictions, automated trading, and economic
modeling.
Key Innovations:
Algorithmic Trading – AI-driven trading strategies optimize financial markets.
AI-driven Economic Forecasting – Predicting inflation, GDP growth, and market crashes.
Game Theory & AI – Used in reinforcement learning for AI decision-making in uncertain
environments.
Applications:
AI-powered fintech (fraud detection, credit scoring).
Supply chain optimization with predictive AI.
AI-driven economic policies and market regulation.
3. Psychology & AI
Understanding human cognition, emotions, and decision-making helps improve AI systems that
interact with people.
Key Innovations:
Affective Computing (Emotion AI) – AI models that detect and respond to human emotions.
Cognitive AI – Simulating human-like reasoning in AI (e.g., IBM Watson).
AI-based Behavioral Analysis – AI-driven analysis of consumer behavior and mental health patterns.
Applications:
AI-powered mental health chatbots (Wysa, Woebot).
Human-AI collaboration in workplaces (AI as a cognitive assistant).
AI-driven personalized learning (adaptive AI tutors).
4. Neuroscience & AI
AI development is inspired by how the human brain processes information and learns.
Key Innovations:
Neuromorphic Computing – AI models that mimic brain neurons for energy-efficient computing.
Brain-Computer Interfaces (BCI) – AI-powered interfaces that allow direct brain-machine
communication (e.g., Neuralink).
Memory-Augmented Neural Networks (MANNs) – AI that mimics human memory and learning
processes.
Applications:
AI-assisted prosthetics and neurorehabilitation.
Brain-inspired deep learning models for advanced reasoning.
AI-driven medical diagnosis for neurological disorders.
5. Mathematics & AI
Mathematics underpins AI through statistics, probability, algebra, and optimization techniques.
Key Innovations:
Bayesian Inference & Probabilistic AI – AI models that handle uncertainty effectively.
Graph Neural Networks (GNNs) – Used in social network analysis and molecular research.
Mathematical Optimization in AI – Improving AI performance using advanced calculus and linear
algebra.
Applications:
AI in scientific research (protein folding, physics simulations).
AI-driven logistics and route optimization.
Improved AI explainability through mathematical models.
6. Linguistics & AI
AI in natural language processing (NLP) helps machines understand, generate, and interact in human
language.
Key Innovations:
Large Language Models (LLMs) – AI models like GPT-4, LLaMA, and Claude understand and
generate human-like text.
Speech Recognition & Synthesis – AI-powered text-to-speech (TTS) and automatic speech
recognition (ASR).
Multilingual AI – AI that understands and translates multiple languages with high accuracy.
Applications:
AI-driven customer support chatbots.
Real-time AI translators and transcription services.
AI-generated content for creative industries (music, writing, and storytelling).
7. Philosophy & AI
Philosophy helps define AI ethics, consciousness, and the nature of intelligence.
Key Innovations:
Ethical AI (Fairness, Bias Reduction) – Ensuring AI is unbiased and responsible.
Explainable AI (XAI) – Making AI decisions interpretable for humans.
AI & Consciousness – Research into whether AI can achieve self-awareness or reasoning beyond
human capability.
Applications:
AI-driven ethical decision-making in automation.
AI in law and governance (legal AI for case analysis).
AI for philosophical research in ethics and morality.
8. Control Theory & AI
Control theory ensures AI systems remain stable, efficient, and adaptive in dynamic environments.
Key Innovations:
Reinforcement Learning (RL) – AI that learns optimal actions based on feedback (e.g., AlphaGo,
OpenAI Five).
Adaptive AI Systems – AI that adjusts parameters dynamically in real-time.
AI-powered Control Systems – Used in industrial automation and robotics.
Applications:
Self-driving cars using AI-based control algorithms.
AI-driven robotic arms in manufacturing.
Autonomous drone control systems.
9. Cybernetics & AI
Cybernetics studies how AI systems interact with biological and mechanical systems.
Key Innovations:
Human-AI Augmentation – AI-powered prosthetics, wearables, and neural implants.
Biohybrid AI – AI integrated with biological elements for enhanced computing.
Autonomous Learning Systems – AI that adapts in real-time like living organisms.
Applications:
AI-powered exoskeletons for mobility assistance.
Neural AI interfaces for controlling machines with thoughts.
AI-driven feedback loops in smart environments (smart cities, IoT).
RISKS OF AI
1. Job
4. Transportation
AI is used by self-driving vehicles to navigate safely and by AI to control trains and air traffic, increasing the
effectiveness of transportation systems and lowering human error on the road.
Benefits: By lowering human error in self-driving automobiles and public transportation networks, artificial
intelligence improves transportation safety. With an extended Scope of Artificial Intelligence, this efficiency
results in safer travels and a smoother travel experience.
5. Retail
AI predicts client demands based on previous purchases, enabling tailored shopping experiences. By keeping
popular commodities supplied, it controls inventories, improving efficiency and convenience.
Benefits: AI provides a more individualized purchasing experience by anticipating client demands. Popular
goods are kept available through effective inventory management, which facilitates shopping and raises overall
consumer satisfaction.
6. Manufacturing
AI-powered robots do monotonous jobs and anticipate equipment malfunctions before they occur. With
increased productivity and lower production costs, this capacity demonstrates the growing Scope of Artificial
Intelligence.
Benefits: AI-powered robots increase productivity by precisely completing monotonous jobs. Estimating the
requirement for equipment maintenance helps to avoid expensive delays, minimize downtime, and maintain
efficient and economical production lines.
AI’s Impact on Job Markets and Workforce Transformation
1. Job Automation
AI changes the demands on the workforce by automating repetitive labor in fields like data input and
manufacturing. In this instance, the Scope of Artificial Intelligence changes responsibilities, boosting
productivity while simultaneously altering employment requirements.
2. Demand for New Skills
Skills like data analysis, machine learning, and AI management are becoming more and more necessary as
mundane activities are replaced by AI. This change places an emphasis on workers' ongoing education and
adaptability.
3. Emergence of New Roles
AI generates jobs such as data scientists, ethical officers, and AI trainers. These positions provide dynamic
career pathways requiring specific knowledge and skills and represent the growing Scope of Artificial
Intelligence.
4. Hybrid Work Environments
AI technologies make remote and flexible work choices possible, facilitating productive employee collaboration.
AI's adaptability in a variety of work environments is demonstrated by this flexibility, which transforms
conventional office tasks.
5. Impact on Job Security
Although AI creates opportunity, certain jobs may become automated, which is a problem. To adjust to
changes within the Scope of Artificial Intelligence, people will need to reskill.
6. Increased Productivity
Workers may concentrate on more strategic and creative initiatives by using AI to handle monotonous jobs,
which eventually increases productivity. This change reinterprets high-impact positions, promoting company
innovation.
In artificial intelligence, an agent is a computer program or system that is designed to perceive its
environment, make decisions and take actions to achieve a specific goal or set of goals. The agent
operates autonomously, meaning it is not directly controlled by a human operator.
Agents can be classified into different types based on their characteristics, such as whether they
are reactive or proactive, whether they have a fixed or dynamic environment, and whether they
are single or multi-agent systems.
Reactive agents are those that respond to immediate stimuli from their environment and take
actions based on those stimuli. Proactive agents, on the other hand, take initiative and plan
ahead to achieve their goals. The environment in which an agent operates can also be fixed or
dynamic. Fixed environments have a static set of rules that do not change, while dynamic
environments are constantly changing and require agents to adapt to new situations.
Multi-agent systems involve multiple agents working together to achieve a common goal.
These agents may have to coordinate their actions and communicate with each other to achieve
their objectives. Agents are used in a variety of applications, including robotics, gaming, and
intelligent systems. They can be implemented using different programming languages and
techniques, including machine learning and natural language processing.
Artificial intelligence is defined as the study of rational agents. A rational agent could be
anything that makes decisions, such as a person, firm, machine, or software. It carries out an
action with the best outcome after considering past and current percepts(agent’s perceptual
inputs at a given instance). An AI system is composed of an agent and its environment. The
agents act in their environment. The environment may contain other agents.
An agent is anything that can be viewed as:
Perceiving its environment through sensors and
Acting upon that environment through actuators
An agent is anything that can be viewed as perceiving its environment through sensors
and acting upon that environment through actuators.
Human Sensors:
Eyes, ears, and other organs for sensors.
Human Actuators:
Hands, legs, mouth, and other body parts.
Robotic Sensors:
Mic, cameras and infrared range finders for sensors
Robotic Actuators:
Motors, Display, speakers etc An agent can be:
Human-Agent: A human agent has eyes, ears, and other organs which work for sensors
and hand, legs, vocal tract work for actuator
Robotic Agent: A robotic agent can have cameras, infrared range finder, NLP for sensors and
various motors for actuators.
Software Agent: Software agent can have keystrokes, file contents as sensory input and
act on those inputs and display output on the screen.
Hence the world around us is full of agents such as thermostat, cell phone, camera, and
even we are also agents. Before moving forward, we should first know about sensors, effectors,
and actuators.
Sensor: Sensor is a device which detects the change in the environment and sends the
information to other electronic devices. An agent observes its environment through sensors.
Actuators: Actuators are the component of machines that converts energy into
motion. The actuators are only responsible for moving and controlling a system. An actuator
can be an electric motor, gears, rails, etc.
Effectors: Effectors are the devices which affect the environment. Effectors can be
legs, wheels, arms, fingers, wings, fins, and display screen.
PROPERTIES OF ENVIRONMENT
An environment is everything in the world which surrounds the agent, but it is not a part of an
agent itself. An environment can be described as a situation in which an agent is present.
The environment is where agent lives, operate and provide the agent with something to sense
and act upon it.
Fully observable vs Partially Observable:
If an agent sensor can sense or access the complete state of an environment at each point of
time then it is a fully observable environment, else it is partially observable.
A fully observable environment is easy as there is no need to maintain the internal state to keep
track history of the world.
An agent with no sensors in all environments then such an environment is called as
unobservable.
Example: chess – the board is fully observable, as are opponent’s moves. Driving – what is
around the next bend is not observable and hence partially observable.
1. Deterministic vs Stochastic
If an agent's current state and selected action can completely determine the next
state of the environment, then such environment is called a deterministic
environment.
stochastic environment is random in nature and cannot be determined
completely by an agent.
In a deterministic, fully observable environment, agent does not need to worry
about uncertainty.
2. Episodic vs Sequential
In an episodic environment, there is a series of one-shot actions, and only the
current percept is required for the action.
However, in Sequential environment, an agent requires memory of past actions
to determine the next best actions.
3. Single-agent vs Multi-agent
If only one agent is involved in an environment, and operating by itself then
such an environment is called single agent environment.
However, if multiple agents are operating in an environment, then such an
environment is called a multi-agent environment.
The agent design problems in the multi-agent environment are different from
single agent environment.
4. Static vs Dynamic
If the environment can change itself while an agent is deliberating then such
environment is called a dynamic environment else it is called a static
environment.
Static environments are easy to deal because an agent does not need to continue
looking at the world while deciding for an action.
However for dynamic environment, agents need to keep looking at the world at
each action.
Taxi driving is an example of a dynamic environment whereas Crossword
puzzles are an example of a static environment.
5. Discrete vs Continuous
If in an environment there are a finite number of precepts and actions that can be
performed within it, then such an environment is called a discrete environment
else it is called continuous environment.
A chess game comes under discrete environment as there is a finite number of
moves that can be performed.
A self-driving car is an example of a continuous environment.
6. Known vs Unknown
Known and unknown are not actually a feature of an environment, but it is an
agent's state of knowledge to perform an action.
In a known environment, the results for all actions are known to the agent.
While in unknown environment, agent needs to learn how it works in order to
perform an action.
It is quite possible that a known environment to be partially observable and an
Unknown environment to be fully observable.
7. Accessible vs. Inaccessible
If an agent can obtain complete and accurate information about the state's
environment, then such an environment is called an Accessible environment
else it is called inaccessible.
An empty room whose state can be defined by its temperature is an example of
an accessible environment.
Information about an event on earth is an example of Inaccessible environment.
Task environments, which are essentially the "problems" to which rational agents are the
"solutions."
PEAS: Performance Measure, Environment, Actuators, Sensors
Performance
The output which we get from the agent. All the necessary results that an agent gives after
processing comes under its performance.
Environment
All the surrounding things and conditions of an agent fall in this section. It basically consists of
all the things under which the agents work.
Actuators
The devices, hardware or software through which the agent performs any actions or processes
any information to produce a result are the actuators of the agent.
Sensors
The devices through which the agent observes and perceives its environment are the sensors of
the agent.
Figure 1.5 Examples of agent types and their PEAS descriptions
Rational Agent - A system is rational if it does the “right thing”. Given what it knows.
Characteristic of Rational Agent
The agent's prior knowledge of the environment.
The performance measure that defines the criterion of success.
The actions that the agent can perform.
The agent's percept sequence to date.
For every possible percept sequence, a rational agent should select an action that is
expected to maximize its performance measure, given the evidence provided by the
percept sequence and whatever built-in knowledge the agent has.
An omniscient agent knows the actual outcome of its actions and can act accordingly; but
omniscience is impossible in reality.
Ideal Rational Agent precepts and does things. It has a greater performance measure.
Eg. Crossing road. Here first perception occurs on both sides and then only action. No
perception occurs in Degenerate Agent.
Eg. Clock. It does not view the surroundings. No matter what happens outside. The clock
works based on inbuilt program.
Ideal Agent describes by ideal mappings. “Specifying which action an agent ought to take
in response to any given percept sequence provides a design for ideal agent”.
Eg. SQRT function calculation in calculator.
Doing actions in order to modify future precepts-sometimes called information
gathering- is an important part of rationality.
A rational agent should be autonomous-it should learn from its own prior knowledge
The Structure of Intelligent Agents
Agent = Architecture + Agent Program
Architecture = the machinery that an agent executes on. (Hardware)
Agent Program = an implementation of an agent
function. (Algorithm, Logic – Software)
CHARACTERISTICS OF INTELLIGENT AGENTS
Situatedness
The agent receives some form of sensory input from its environment, and it performs some action that
changes its environment in some way.
Examples of environments: the physical world and the Internet.
Autonomy
The agent can act without direct intervention by humans or other agents and that it has control over its
own actions and internal state.
Adaptivity
The agent is capable of
(1) reacting flexibly to changes in its environment;
(2) taking goal-directed initiative (i.e., is pro-active), when appropriate; and
(3) Learning from its own experience, its environment, and interactions with others.
• Sociability
The agent is capable of interacting in a peer-to-peer manner with other agents or humans.
TYPES OF AGENTS
Agents can be grouped into four classes based on their degree of perceived intelligence and
capability:
Simple Reflex Agents
Model-Based Reflex Agents
Goal-Based Agents
Utility-Based Agents
Learning Agent
THE SIMPLE REFLEX AGENTS
The Simple reflex agents are the simplest agents. These agents take decisions on the basis of the
current percepts and ignore the rest of the percept history (past State).
These agents only succeed in the fully observable environment.
The Simple reflex agent does not consider any part of percepts history during their decision and
action process.
The Simple reflex agent works on Condition-action rule, which means it maps the current state
to action. Such as a Room Cleaner agent, it works only if there is dirt in the room.
Problems for the simple reflex agent design approach:
o They have very limited intelligence
o They do not have knowledge of non-perceptual parts of the current state
o Mostly too big to generate and to store.
o Not adaptive to changes in the environment.
Condition-Action Rule − It is a rule that maps a state (condition) to an action.
Ex: if car-in-front-is-braking then initiate- braking.
Figure. A simple reflex agent
MODEL BASED REFLEX AGENTS
The Model-based agent can work in a partially observable environment, and track
the situation.
A model-based agent has two important factors:
o Model: It is knowledge about "how things happen in the world," so it is called
a Model-based agent.
o Internal State: It is a representation of the current state based on percept
history.
These agents have the model, "which is knowledge of the world" and based on the
model they perform actions.
Updating the agent state requires information about:
o How the world evolves
o How the agent's action affects the world.
LEARNING AGENTS
o A learning agent in AI is the type of agent which can learn from its past
experiences, or it has learning capabilities.
o It starts to act with basic knowledge and then able to act and adapt automatically
through learning.
o A learning agent has mainly four conceptual components, which are:
a. Learning element: It is responsible for making improvements by learning
from environment
b. Critic: Learning element takes feedback from critic which describes that how
well the agent is doing with respect to a fixed performance standard.
c. Performance element: It is responsible for selecting external action
AI is an advancement made by
On the other hand, human
human insights; its early
creatures are made with the
1. Emergence improvement is credited to
intrinsic capacity to think,
Norbert Weiner who theorized
reason, review, etc.
on criticism mechanisms.
As compared to people,
computers can handle more data
at a speedier rate. For
In terms of speed, humans
Pace/Rate of occurrence, in the event that the
5. cannot beat the speed of AI
AI and human human intellect can solve a
or machines.
math problem in 5 minutes, AI
can solve 10 problems in a
minute.
S.
No. Feature Artificial Intelligence Human Intelligence
Human Intelligence
Artificial Intelligence
Introduction
Definition of learning
Definition
A computer program is said to learn from experience E with respect to some class of
tasks T and performance measure P , if its performance at tasks T , as measured by P ,
improves with experience E.
Examples
i) Handwriting recognition learning problem
Definition
A computer program which learns from experience is called a machine learning program or simply a
learning program. Such a program is sometimes also referred to as a learner.
1.2 How machines learn
1.2.1 Basic components of learning process
The learning process, whether by a human or a machine, can be divided into four
components, namely, data storage, abstraction, generalization and evaluation. Figure 1.1
illustrates the various components and the steps involved in the learning process.
Data storage Abstraction Generalization Evaluation
2. In finance, banks analyze their past data to build models to use in credit applications, fraud detection,
and the stock market.
3. In manufacturing, learning models are used for optimization, control, and troubleshooting.
4. In medicine, learning programs are used for medical diagnosis.
5. In telecommunications, call patterns are analyzed for network optimization and maximizing the
quality of service.
6. In science, large amounts of data in physics, astronomy, and biology can only be analyzed fast
enough by computers. The World Wide Web is huge; it is constantly growing and searching for
relevant information cannot be done manually.
7. In artificial intelligence, it is used to teach a system to learn and adapt to changes so that the system
designer need not foresee and provide solutions for all possible situations.
8. It is used to find solutions to many problems in vision, speech recognition, and robotics.
9. Machine learning methods are applied in the design of computer-controlled vehicles to steer correctly
when driving on a variety of roads.
Machine learning methods have been used to develop programmes for playing games such as chess,
backgammon and Go.
Examples
• A person, an object or a thing
• A time point
• A geographic region
• A measurement
2. Pet selection
Suppose we want to predict the type of pet a person will choose.
(a) The units are the persons.
(b) The examples are members of a sample of persons who own pets.
Figure 1.2: Example for “examples” and “features” collected in a matrix format (data
relates to automobiles and their features)
(c) The features might include age, home region, family income, etc. of persons who own pets.
3. Spam e-mail
Let it be required to build a learning algorithm to identify spam e-mail.
(a) The unit of observation could be an e-mail messages.
(b) The examples would be specific messages.
(c) The features might consist of the words used in the messages.
Examples and features are generally collected in a “matrix format”. Fig. 1.2 shows such a data
set.
Examples
In the data given in Fig.1.2, the features “year”, “price” and “mileage” are numeric and the
features “model”, “color” and “transmission” are categorical.
2. Example
follows: “80% of customers who buy onion and potato also buy burger.”
5. Algorithms
There are several algorithms for generating association rules. Some of the well-known
algorithms are listed below:
a) Apriori algorithm
b) Eclat algorithm
c) FP-Growth Algorithm (FP stands for Frequency Pattern)
1.4.4 Classification
1. Definition
Score1 29 22 10 31 17 33 32 20
Score2 43 29 47 55 18 54 40 41
Result Pass Fail Fail Pass Fail Pass Pass Pass
Data in Table 1.1 is the training set of data. There are two attributes “Score1” and “Score2”. The class
label is called “Result”. The class label has two possible values “Pass” and “Fail”. The data can be divided
into two categories or classes: The set of data for which the class label is “Pass” and the set of data for
which the class label is“Fail”.
Let us assume that we have no knowledge about the data other than what is given in the table. Now, the
problem can be posed as follows: If we have some new data, say “Score1 = 25” and “Score2 = 36”, what
value should be assigned to “Result” corresponding to the new data; in other words, to which of the two
categories or classes the new observation should be assigned? See Figure
1.3 for a graphical representation of the problem.
Score2
60
50
40
?
30
20
Score1
10 0 10 20 30 40
Figure 1.3: Graphical representation of data in Table 1.1. Solid dots represent data in
“Pass” class and hollow dots data in “Fail” class. The class label of the square dot is to be
determined.
To answer this question, using the given data alone we need to find the rule, or the formula, or the method that has
been used in assigning the values to the class label “Result”. The problem of finding this rule or formula or the
method is the classification problem. In general, even the general form of the rule or function or method will not
be known. So several different rules, etc. may have to be tested to obtain the correct rule or function or method
1. Real life examples
i) Optical character recognition
Optical character recognition problem, which is the problem of recognizing
character codes from their images, is an example of classification problem. This is
an example where there are multiple classes, as many as there are characters we
would like to recognize. Especially interesting is the case when the characters are
handwritten. People have different handwrit- ing styles; characters may be written
small or large, slanted, with a pen or pencil, and there are many possible images
corresponding to the same character.
ii) Face recognition
In the case of face recognition, the input is an image, the classes are people to be
recognized, and the learning program should learn to associate the face images to
identities. This prob- lem is more difficult than optical character recognition
because there are more classes, input image is larger, and a face is three-
dimensional and differences in pose and lighting cause significant changes in the
image.
iii) Speech recognition
In speech recognition, the input is acoustic and the classes are words that can be uttered.
iv) Medical diagnosis
In medical diagnosis, the inputs are the relevant information we have about the
patient and the classes are the illnesses. The inputs contain the patient’s age,
gender, past medical history, and current symptoms. Some tests may not have been
applied to the patient, and thus these inputs would be missing.
v) Knowledge extraction
Classification rules can also be used for knowledge extraction. The rule is a simple
model that explains the data, and looking at this model we have an explanation
about the process underlying the data.
vi) Compression
Classification rules can be used for compression. By fitting a rule to the data, we
get an explanation that is simpler than the data, requiring less memory to store and
less computation to process.
vii) More examples
Here are some further examples of classification problems.
(a) An emergency room in a hospital measures 17 variables like blood pressure, age, etc. of newly
admitted patients. A decision has to be made whether to put the patient in an ICU. Due to the
high cost of ICU, only patients who may survive a month or more are given higher priority.
Such patients are labeled as “low-risk patients” and others are labeled “high-risk patients”.
The problem is to device a rule to classify a patient as a “low-risk patient” or a “high-risk
patient”.
(b) A credit card company receives hundreds of thousands of applications for new cards. The
applications contain information regarding several attributes like annual salary, age, etc. The
problem is to devise a rule to classify the applicants to those who are credit-worthy, who are
not credit-worthy or to those who require further analysis.
(c) Astronomers have been cataloguing distant objects in the sky using digital images cre- ated
using special devices. The objects are to be labeled as star, galaxy, nebula, etc. The data is
highly noisy and are very faint. The problem is to device a rule using which a distant object
can be correctly labeled.
3. Discriminant
Examples
i) Consider the data given in Table 1.1 and the associated classification problem. We may consider
the following rules for the classification of the new data:
Or, we may consider the following rules with unspecified values for M, m1, m2 and
then by some method estimate their values.
IF Score1 + Score2 ≥ M , THEN “Pass” ELSE “Fail”.
IF Score1 ≥ m1 AND Score2 ≥ m2 THEN “Pass” ELSE “Fail”.
i) Consider a finance company which lends money to customers. Before lending money, the company
would like to assess the risk associated with the loan. For simplicity, let us assume that the company
assesses the risk based on two variables, namely, the annual income and the annual savings of the
customers.
Let x1 be the annual income and x2 be the annual savings of a customer.
• After using the past data, a rule of the following form with suitable values for θ1 and
θ2 may be formulated:
IF x1 θ1 AND>x2 θ2 THEN “low-risk” ELSE “high-risk”.
This rule is an example of>a discriminant.
• Based on the past data, a rule of the following form may also be formulated: IF x2 –
0.2x1 > 0 THEN “low-risk” ELSE “high-risk”.
In this case the rule may be thought of as the discriminant. The function f (x1, x2) =
x2 – 0, 2x1 can also be considered as the discriminant.
1. Algorithms
There are several machine learning algorithms for classification. The following are some of the well-
known algorithms
a) Logistic regression
b) Naive Bayes algorithm
c) k-NN algorithm
d) Decision tree algorithm