Biometric and smart card access points are increasingly becoming equipped with additional input sensors, integrated intelligent video surveillance systems and advanced intelligent methods that learn from experience. We have designed a flexible modular system based on integration of arbitrary access control sensors and an arbitrary number of stand-alone modules. The system was tested with four sensors (door sensor, identity card reader, fingerprint reader, camera) and four independent modules (expert-defined rules, micro learning, macro learning and visual learning). Preliminary tests of the designed prototype show encouraging results and justifies integration of intelligent detection of unusual behavior in future access control systems for intelligent homes, industry facilities, offices, hospitals, military campuses etc.