Yes, you can follow Jesus without attending church, but one of the most important aspects of following Jesus is fellowship with other believers - when you trusted Jesus as your Lord and Savior He started a fellowship with you and now you need to do as He did and fellowship with other believers...