I agree. he's also the only one whose home we've never seen (unless I DID miss an episode in Season 1). We've seen Gwen's flat several times, Owen's penthouse-style place a couple of times and saw both Tosh's house in Season 1 and her new flat in Season 2. Hell, we've even seen Jack's crash-place underneath his office. But nothing at all for Ianto.
Interview with SFX just as Season 2 started, GDL says that Ianto has nothing other than Torchwood and Jack. Which kind of fits with his memories in "Adam" as you've said. He openly says that Torchwood gave his life meaning again. And the "you" and the look on his face as he looks at Jack makes it quite clear that Jack is the only other meaningful thing in his life.
Ianto
Interview with SFX just as Season 2 started, GDL says that Ianto has nothing other than Torchwood and Jack. Which kind of fits with his memories in "Adam" as you've said. He openly says that Torchwood gave his life meaning again. And the "you" and the look on his face as he looks at Jack makes it quite clear that Jack is the only other meaningful thing in his life.