It always seems that once the warmer weather comes, we find ourselves feeling like we're ready to explore the whole world...or maybe just as much of New York as we can. With our bucket lists growing longer by the minute, it's time to slip in a few historical sweet spots that you'll absolutely want to check out. Filled with interesting history and beautiful scenery, each one of these landmarks offers you something unique to experience.

Pens at the ready, here are 11 historical landmarks in our state you'll want to make a note of to visit:

1. Montauk Point Light, Montauk Point

New York's very first lighthouse, this picturesque landmark was only just named a National Historic Landmark in 2012, wow! Generally when you picture a lighthouse in your head, you visualize something beautiful like the scene you see before you at Montauk Point. Surrounded by the ocean and the wildlife of our state, the views from the top of the lighthouse will drop your jaw.

2. Yaddo Gardens, Saratoga Springs

In case you were looking for more excuses to come and check out one of New York's charming gardens, this one was named a historic landmark in 2013! If spending the day a the fast paced track isn't quite your style, then this may be the perfect alternative. With plenty to do in the Saratoga area, Yaddo provides a relaxing space for visitors to come and enjoy the relaxing scenery.

3. Kleinhans Music Hall, Buffalo

Made a historic landmark in 1989, this marvelous music hall is home to the Buffalo Philharmonic Orchestra! Recognized widely for being one of the greatest music halls there is, this site was created as the last wish of the Kleinhans family. Owners of a well-known clothing store, the husband and wife left roughly a million dollars behind when they passed, specifically to create a music hall.

4. Fort Ticonderoga, Ticonderoga

One of America's first popular attractions, tourists have been visiting this old war fortress since the early 1900's! A reconstruction was completed in 1909 and since then the historical site has been open to visitors. The star-shaped site was declared a historical landmark in the fall of 1960 and is more than your average old war ruins. On the grounds you'll also find a gorgeous garden fit for a fairy princess and canoe rentals to let you explore the surrounding waters.

5. Kykuit, Sleepy Hollow

If you're having trouble pronouncing the name of this gorgeous historical site, you may be pleased to know that it's also commonly referred to as the John D. Rockefeller Estate. Better? Made a historic landmark in 1976, the site features a stunning house with 40 rooms, breathtaking gardens and charming pieces of art everywhere. Overlooking the Hudson River, coming here is a great way to spend your day.

6. Playland, Rye

Considering Playland is a pretty general name, you'll often hear this spot being called Rye Playland or Playland Amusement Park to help specify things a little bit. Made a historic landmark in 1987, this downstate treasure is not too far from the Connecticut border, drawing in visitors from all over. The amusement park gained an even bigger audience after the 1988 film Big was released starring Tom Hanks.

7. Lyndhurst Mansion, Tarrytown

Accessible by guided tours which last an hour long, the grounds of the Lyndhurst estate are something to be seen. Also referred to as the Jay Gould estate, this gothic-style castle is like something out of an old movie. Sitting on nearly 70 acres of land, the estate was was named a historic landmark in 1966.

8. Fort Crown Point, Crown Point

Built in the 1700's, this historic fortress falls closely to the border of Vermont. Seeing these ruins in person will you remind you exactly how far New York's history dates back and all that has changed over the years. The area itself is full of history and has plenty of fantastic sites to explore nearby, the ruins were declared a historic landmark in 1968.

9. Darwin D. Martin House, Buffalo

Designed by Frank Lloyd Wright in the early 1900's, the complex is known as one of the architects most notable creations. Hard to fathom, this structurally magnificent complex was once a New York resident's home! To maintain the homes beauty, the complex has undergone restorations over the years to preserve its history and was declared a historic landmark in 1986.

10. Montgomery Place, Annandale on Hudson

Apart of the New York Hudson River Historic District, the site was made a historical landmark in 1975. The property features a Main House that overlooks the Hudson River and has lush green grounds for you to explore. Built in the early 1800's, you can explore trails that take you around the property and through its beautiful gardens for a truly wonderful experience. Our advice? Pack a picnic and enjoy the warm weather!

11. Sagamore Hill, Oyster Bay

Once home to the America's 26th President, the historic residence can be found on the northern shores of Long Island. Theodore Roosevelt's home until his passing in 1919, the site has been on New York's list of historic places since 1966. Known as one of the peoples favorite presidents, Sagamore Hill has been a longtime favorite site for those visiting New York to come and explore.

Have you ever spent the day diving into New York's history at one of these amazing spots? Share with us at Only In New York what your favorite historical landmarks are!