SARVAGNAMS are Muluknadu Telugu Brahmans. from Cheranmahadevi , Tirunelveli District, in Tamilnadu, India. History of Muluknadu Brahmans is spelled-out in http://en.wikipedia.org/wiki/Muluknadu.
As per learned Historians of, this region, the SARVAGNAMS were the early settlers from Rayalaseema, doing vedic rituals. They were invited by, then Kings, of the region, for conducting Yagnams(Hindu Ritual). SARVAGNAMS were the one, who could conduct, many Yagnams. Similarly SOMAYAJIS, who were apt at doing 'Soma Yagnam'.
Our family tree dating back up to 19th century can be seen on this link:
http://www.tribalpages.com/tribes/sarvajaya (Password - sarvagnam).

The photo is of Family Deity - KAMAAKSHI AMMAN in Cheranmahadevi.