Ilion is a village in Herkimer County, New York, United States. The population was 8,053 at the 2010 census. "Ilion" is a name for the ancient city of Troy.The village is at the northern edge of the town of German Flatts, though a tiny portion is in the town of Frankfort. It is south of the Mohawk River and Erie Canal.