Augmented Reality (AR) uses a combination of hardware and software to enhance a person's vision of the world with useful information about his/her surroundings. In recent years, there have been many different implementations of Augmented Reality. The vast majority of these implementations have assumed that lighting conditions are static, usually in an indoor or outdoor environment. Unfortunately, many of these implementations have difficulty adapting to new lighting conditions, especially when the conditions change abruptly. This paper addresses this issue by presenting a robust system that is able to tolerate such changes in lighting conditions. Thus, this paper will show how to construct a vision component of an Augmented Reality system that will help adjust the system automatically to both indoor and outdoor lighting conditions.