Papers by Mohammed Mynuddin
The research of reinforcement learning is increasing recently due to its application in different... more The research of reinforcement learning is increasing recently due to its application in different fields, such as control engineering, transportation systems, power system control, and medical science. In this thesis, we have developed a distributed internal adaptive model to solve problems related to cooperative output regulation and an adaptive distributed observer to estimate the leader’s system matrix. We designed a novel distributed predictive cruise control algorithm using reinforcement learning. The main objective of this controller is to reduce travel time and fuel consumption depending on the adjustable speed of the vehicle. This thesis integrates the control algorithm and Paramics microscopic traffic simulations using an application programming interface. We studied the distraction of drivers for different counter measurements, such as text messaging, eating, talking to another passenger, observing advertising boards, and their combinations. The data of steering angle deviation and velocity deviation are analyzed by using statistical tools
Bookmarks Related papers MentionsView impact
In this paper, we propose a reinforcement learning (RL) approach to the coordinated control of mu... more In this paper, we propose a reinforcement learning (RL) approach to the coordinated control of multi-agent systems with a special emphasis on intelligent transportation systems. As a result, for a network of autonomous vehicles, a novel distributed predictive cruise control (PCC) algorithm based on RL is proposed to reduce idle time and maintain an adjustable speed depending on the traffic signals. Under the proposed distributed PCC law, given the signal phase and timing (SPaT) message from upcoming traffic intersections, autonomous vehicles can cross intersections without stopping. The effectiveness of the proposed approach has been validated through Paramics microscopic traffic simulations by choosing a scenario in Statesboro, Georgia. For different traffic demands, the travel time and fuel consumption rate of vehicles are compared between non-PCC and PCC algorithms. Microscopic traffic simulation results show that the proposed PCC algorithm is able to reduce both fuel consumption...
Bookmarks Related papers MentionsView impact
This paper is designed solar tracking system with mirror booster using microcontroller. Solar ene... more This paper is designed solar tracking system with mirror booster using microcontroller. Solar energy is rapidly becoming an alternative means of electrical source all over the world. To make effective use of solar energy, its efficiency must be maximized. A feasible approach to maximizing the power output of solar array is by sun tracking. This paper deals with the design and construction of solar tracking system by using a stepper motor, gear motor, photo diode. Mirror is used as booster to maximize the efficiency. The whole frame will travel circularly and the mirror will travel from south to north and vice-versa. The prototype is considered around a programmed microcontroller which controls the system by communicating with sensors and motor driver based on movement of the sun. The performance and characteristics of the solar tracker are experimentally analyzed.
Bookmarks Related papers MentionsView impact
Science Journal of Circuits, Systems and Signal Processing, 2015
Bookmarks Related papers MentionsView impact
International Journal of Energy and Power Engineering, 2015
Bookmarks Related papers MentionsView impact
International Journal of Computer Applications, 2015
Bookmarks Related papers MentionsView impact
International Journal of Information Technology and Computer Science, 2013
Bookmarks Related papers MentionsView impact
Bookmarks Related papers MentionsView impact
IET Intelligent Transport Systems
This study proposes a novel distributed predictive cruise control (PCC) algorithm based on reinfo... more This study proposes a novel distributed predictive cruise control (PCC) algorithm based on reinforcement learning. The algorithm aims at reducing idle time and maintaining an adjustable speed depending on the traffic signals. The effectiveness of the proposed approach has been validated through Paramics microscopic traffic simulations by proposing a scenario in Statesboro, Georgia. For different traffic demands, the travel time and fuel consumption rate of vehicles are compared between non-PCC and PCC algorithms. Microscopic traffic simulation results demonstrate that the proposed PCC algorithm will reduce the fuel consumption rate by 4.24% and decrease the average travel time by 3.78%.
Bookmarks Related papers MentionsView impact
The motivation of this paper is to design and fabrication a cost effective magnetic levitation (s... more The motivation of this paper is to design and fabrication a cost effective magnetic levitation (shortly called Maglev) system using PLC. For this purpose a stand, a 12 volt electromagnet, eddy current displacement sensor which input voltage is 24 volt and output voltage range is 0 to 10 volt for 0 to 10 mm displacement, Siemens Logo PLC setup board including CPU, cable, analog expansion module, an amplifier circuit & Logo soft software are used. Sensor senses the displacement of a target and gives corresponding signal in terms of voltage. This sensor output voltage is used as input in PLC input terminal. CPU works according to ladder diagram which is installed in program memory. The electromagnet is connected to the analog expansion output terminal. The current is controlled by PLC according to sensor signal which passes through the electromagnet. When distance between the sensor and target is increased the output sensor voltage is increased. PLC receives this voltage and decrease t...
Bookmarks Related papers MentionsView impact
IEEE transactions on neural networks and learning systems, 2021
In this article, a data-driven distributed control method is proposed to solve the cooperative op... more In this article, a data-driven distributed control method is proposed to solve the cooperative optimal output regulation problem of leader-follower multiagent systems. Different from traditional studies on cooperative output regulation, a distributed adaptive internal model is originally developed, which includes a distributed internal model and a distributed observer to estimate the leader's dynamics. Without relying on the dynamics of multiagent systems, we have proposed two reinforcement learning algorithms, policy iteration and value iteration, to learn the optimal controller through online input and state data, and estimated values of the leader's state. By combining these methods, we have established a basis for connecting data-distributed control methods with adaptive dynamic programming approaches in general since these are the theoretical foundation from which they are built.
Bookmarks Related papers MentionsView impact
American journal of mechanical engineering, 2016
The motivation of this paper is to design and fabrication a cost effective magnetic levitation (s... more The motivation of this paper is to design and fabrication a cost effective magnetic levitation (shortly called Maglev) system using PLC. For this purpose a stand, a 12 volt electromagnet, eddy current displacement sensor which input voltage is 24 volt and output voltage range is 0 to 10 volt for 0 to 10 mm displacement, Siemens Logo PLC setup board including CPU, cable, analog expansion module, an amplifier circuit & Logo soft software are used. Sensor senses the displacement of a target and gives corresponding signal in terms of voltage. This sensor output voltage is used as input in PLC input terminal. CPU works according to ladder diagram which is installed in program memory. The electromagnet is connected to the analog expansion output terminal. The current is controlled by PLC according to sensor signal which passes through the electromagnet. When distance between the sensor and target is increased the output sensor voltage is increased. PLC receives this voltage and decrease t...
Bookmarks Related papers MentionsView impact
Bookmarks Related papers MentionsView impact
One of the most important and widely used Radio frequency (RF) antennas is the dipole antenna. Th... more One of the most important and widely used Radio frequency (RF) antennas is the dipole antenna. This is commonly used on its own and is also integrated into many other prototypes of the RF antenna, where it is the guiding factor for the antenna. An effort has been made in this project to study the latest half wave dipole antenna for LTE Applications. The dipole antenna, which is nearly one-half wavelength long, is known as the half-wave dipole antenna. The antenna was designed for resonating at the frequency of 2.6 GHz. For the simulation and design calculations CST is used. In this project various factors of antenna such as the return loss, standing wave ratio from Smith charts, Real power Vs Frequency, VSWR, E-field and H-field distribution, gain and radiation pattern are also evaluated.
Bookmarks Related papers MentionsView impact
In this paper, we propose a reinforcement learning (RL) approach to the coordinated control of mu... more In this paper, we propose a reinforcement learning (RL) approach to the coordinated control of multi-agent systems with a special emphasis on intelligent transportation systems. As a result, for a network of autonomous vehicles, a novel distributed predictive cruise control (PCC) algorithm based on RL is proposed to reduce idle time and maintain an adjustable speed depending on the traffic signals. Under the proposed distributed PCC law, given the signal phase and timing (SPaT) message from upcoming traffic intersections, autonomous vehicles can cross intersections without stopping. The effectiveness of the proposed approach has been validated through Paramics microscopic traffic simulations by choosing a scenario in Statesboro, Georgia. For different traffic demands, the travel time and fuel consumption rate of vehicles are compared between non-PCC and PCC algorithms. Microscopic traffic simulation results show that the proposed PCC algorithm is able to reduce both fuel consumption rate and travel time.
Bookmarks Related papers MentionsView impact
American Journal of Modern Physics
Bookmarks Related papers MentionsView impact
International Journal of Electromagnetics and Applications, 2020
In this paper, an inset feed rectangular microstrip patch antenna has been designed and simulated... more In this paper, an inset feed rectangular microstrip patch antenna has been designed and simulated at the frequency of 3GHz and the dependency of antenna performance parameters like return loss, VSWR and other antenna parameters have been successfully studied with the variation of the notch gap using CST microwave studio. We have varied the notch width(g) as the proportion of the Length(L), Width(W) of the patch and the width of the microstrip feed line (Wf) to study the performance parameters of patch antenna. FR-4 with dielectric constant of 4.3 is used as a substrate for the designed antenna. The designed rectangular microstrip patch antenna with inset feed technique is very useful for various applications in Industrial, Scientific and Medical sectors which operates at 3GHz range. It shows that the return loss decreases within some certain values of the notch width (g) and after those values the return loss and VSWR started to increase with the corresponding notch gap. Although the return loss and VSWR change with varying the notch gap but no significant changes were observed in case of gain, directivity and bandwidth. The resonant frequency of our designed antenna was almost same with the variation of the notch gap and it remained almost fixed from 2.944 GHz-2.978 GHz.
Bookmarks Related papers MentionsView impact
This paper basically represents how to deblurring images
using a wiener filter [1]. B... more This paper basically represents how to deblurring images
using a wiener filter [1]. Basically wiener filter is used to
produce an estimate of a desired or target random process by
linear time-invariant filtering [2] of an observed noisy
process, assuming known stationary signal and noise spectra,
and additive noise. The Wiener filter minimizes the mean
square error between the estimated random process and the
desired process. In here it has been introduced about the
image processing capabilities in MATHLAB. Dividing some
steps it has been shown how an image can be processed with
the help of MATHLAB [3][4] command. Moreover how
image can be effected by noise & how noise can be removed
from image this also described in this paper properly
Bookmarks Related papers MentionsView impact
International Journal of Modern Embedded System (IJMES), 2014
All over the world, security has been a major concern in every home. Automated secur... more All over the world, security has been a major concern in every home. Automated security systems are a useful addition to todays
home where safety is an important issue. Vision-based security systems have the advantage of being easy to set up, inexpensive and non-obtrusive. Here, a security system has been developed that uses sensors to detect any security violation and sends out the alert signal by high
intensity Buzzer. In this paper it has been ensured three level security systems. NFC tag use, providing Password and PIR motion sensor. To
open the door a person should provide NFC tag and password. If one of them absence the door will not open. The door will opened by
servomotor with a lock coupled in its shaft. When wrong password is pressed, error text is displayed in the LCD. When an authorized person
leaves the door, he has to show his tag in the reader. Otherwise the door will not close. Now if an unwanted man enters the room by password
breaking or without NFC the PIR sensor works .It sounds the buzzer. NFC card reader, PIC 16F877A, Arduino Uno, PIR sensor is used for this
project .So, maximum security will be maintained in home. This security can be applied not only home but also the place where important
document, file are preserved also the bank vault.
Bookmarks Related papers MentionsView impact
This paper will clarify about a smart feature with phone technology. Here it’s also mentioned tha... more This paper will clarify about a smart feature with phone technology. Here it’s also mentioned that utilizing this feature, how a process
would be so easier. Basically this technology will navigate through images from Gallery, tracks from audio and video albums, skipping video
forward backward by 10s interval and navigate through S planner through gesture motion. This would be a new concept of navigation in touch
sensitive devices using Gesture motion for media contents & S Planner contents. Gesture motion for media contents included [1] Browsing
through images and image albums one by one [2] Skipping video clips by seconds backwards forwards while playing [3] Browsing through
audio albums one by one. On the other hand Gesture motion for S Planner contents included [1] Browsing through the planner one after another.
Bookmarks Related papers MentionsView impact
Uploads
Papers by Mohammed Mynuddin
using a wiener filter [1]. Basically wiener filter is used to
produce an estimate of a desired or target random process by
linear time-invariant filtering [2] of an observed noisy
process, assuming known stationary signal and noise spectra,
and additive noise. The Wiener filter minimizes the mean
square error between the estimated random process and the
desired process. In here it has been introduced about the
image processing capabilities in MATHLAB. Dividing some
steps it has been shown how an image can be processed with
the help of MATHLAB [3][4] command. Moreover how
image can be effected by noise & how noise can be removed
from image this also described in this paper properly
home where safety is an important issue. Vision-based security systems have the advantage of being easy to set up, inexpensive and non-obtrusive. Here, a security system has been developed that uses sensors to detect any security violation and sends out the alert signal by high
intensity Buzzer. In this paper it has been ensured three level security systems. NFC tag use, providing Password and PIR motion sensor. To
open the door a person should provide NFC tag and password. If one of them absence the door will not open. The door will opened by
servomotor with a lock coupled in its shaft. When wrong password is pressed, error text is displayed in the LCD. When an authorized person
leaves the door, he has to show his tag in the reader. Otherwise the door will not close. Now if an unwanted man enters the room by password
breaking or without NFC the PIR sensor works .It sounds the buzzer. NFC card reader, PIC 16F877A, Arduino Uno, PIR sensor is used for this
project .So, maximum security will be maintained in home. This security can be applied not only home but also the place where important
document, file are preserved also the bank vault.
would be so easier. Basically this technology will navigate through images from Gallery, tracks from audio and video albums, skipping video
forward backward by 10s interval and navigate through S planner through gesture motion. This would be a new concept of navigation in touch
sensitive devices using Gesture motion for media contents & S Planner contents. Gesture motion for media contents included [1] Browsing
through images and image albums one by one [2] Skipping video clips by seconds backwards forwards while playing [3] Browsing through
audio albums one by one. On the other hand Gesture motion for S Planner contents included [1] Browsing through the planner one after another.
using a wiener filter [1]. Basically wiener filter is used to
produce an estimate of a desired or target random process by
linear time-invariant filtering [2] of an observed noisy
process, assuming known stationary signal and noise spectra,
and additive noise. The Wiener filter minimizes the mean
square error between the estimated random process and the
desired process. In here it has been introduced about the
image processing capabilities in MATHLAB. Dividing some
steps it has been shown how an image can be processed with
the help of MATHLAB [3][4] command. Moreover how
image can be effected by noise & how noise can be removed
from image this also described in this paper properly
home where safety is an important issue. Vision-based security systems have the advantage of being easy to set up, inexpensive and non-obtrusive. Here, a security system has been developed that uses sensors to detect any security violation and sends out the alert signal by high
intensity Buzzer. In this paper it has been ensured three level security systems. NFC tag use, providing Password and PIR motion sensor. To
open the door a person should provide NFC tag and password. If one of them absence the door will not open. The door will opened by
servomotor with a lock coupled in its shaft. When wrong password is pressed, error text is displayed in the LCD. When an authorized person
leaves the door, he has to show his tag in the reader. Otherwise the door will not close. Now if an unwanted man enters the room by password
breaking or without NFC the PIR sensor works .It sounds the buzzer. NFC card reader, PIC 16F877A, Arduino Uno, PIR sensor is used for this
project .So, maximum security will be maintained in home. This security can be applied not only home but also the place where important
document, file are preserved also the bank vault.
would be so easier. Basically this technology will navigate through images from Gallery, tracks from audio and video albums, skipping video
forward backward by 10s interval and navigate through S planner through gesture motion. This would be a new concept of navigation in touch
sensitive devices using Gesture motion for media contents & S Planner contents. Gesture motion for media contents included [1] Browsing
through images and image albums one by one [2] Skipping video clips by seconds backwards forwards while playing [3] Browsing through
audio albums one by one. On the other hand Gesture motion for S Planner contents included [1] Browsing through the planner one after another.