The raft layers setting controls the number of layers at the interface between the raft and the part. You will still get all the lower layers that make up the raft foundation (unless you disable raft base layers).
I never use the base layers whenever I have to use a raft..unless I have severe issues with shrinkage causing curling off the bed, when I pull out all the stops and use mouse ears all over the place!!