Why is my fish tank turning brown?

Is the tank near sunlight? I experienced the same thing, but for some strange reason, only the tanks that had sunlight hitting them get it. I think its some sort of algae. If you have driftwood or pebbles, that could be the cause, since after we removed all the fish's pebbles (some fish were swallowing theirs) the algae stopped growing.