Graphene is what you're looking for.
With a tensile strength of 130000 MPa, it has (IIRC) the highest tensile strength in the world.
So lets make a wire-thin sword!
I envision it to probably end up looking something like this:
>----------------------------------------------<|
||||||| |
L_______________________________________________|
where the -------
represent the blade, and the <|
the tip that the other end of the blade is connected to, and the ||||>
represents a handle. It's important to note that the wire is being pulled taut by the <|
piece at the end of the blade. The L____|
represents a structure similar to that of a hacksaw, in order to hold the wires tightly.
This is a slashing/chopping weapon.
How/Why does this work?
The "Graphene wire" is really a Graphene ribbon
Graphene itself contains elastic properties, which helps with the above concept of cutting. Even if the Graphene doesn't cut right away, the elasticity will help it to continue cutting as you swing the blade through your target. "Graphene sheets (with thicknesses of between 2 and 8 nm) had spring constants in the region of 1-5 N/m and a Young’s modulus (different to that of three-dimensional graphite) of 0.5 TPa."
Graphene also has amazing shear strength. Shear modulus of graphite was reported to be ~0.44 TPa. To give you some context, the shear strength of a carbon diamond structure is ~93 GPa. 1 TPa is 1000 GPa.
To answer your question: Yes, you can.
Unfortunately, because the human body is so variable, I can't find any actual numbers regarding how much force is required to tear off a limb - however, we should note that this blade doesn't apply force the same way a sword does.
A sword cuts and splits the target because it "wedges" it apart. In this case, however, because we have a monomolecular ribbon that's completely flat, we should be able to pass through the entire target (irrelevant of what the target is made of, but assuming you gave it a good chop with no deviation in blade angle) extremely easily, since all we're severing are molecular bonds. Forces at the molecular level are at the pico-Newton level (1pN = $10^{-12}$ N); what we exert on anything using anything at any given time exerts more force than what's required. Here's some more context: One pound of force gives us 43.62 Newtons. Even a toddler could exert one pound of force by accident - so if you gave this thing to a baby and he accidentally swung it through you, good luck.
Thank you to Samuel for pointing out some numbers for me: "the shear strength of the Graphene ribbon is maybe 4200 piconewtons / angstrom, while fibers in the skin, like collagen, have a shear strength of only 5.5 piconewtons / angstrom." These numbers show that along the same area, the ribbon has a shear strength of over 750 times that of collagen.
Skin seems easy to cut though. What about bone? Luckily for us, most of bone's elasticity comes from the collagen in it, which means we cut bone just as easily as we do skin.
For an adult? It cuts anything, and everything, better than warm butter.
Once you finish slicing, the limb will only be held on by suction and surface tension. Any movement, and it simply slides/pops off.
However, even regarding the above saying that it is possible in theory, this tool is much better suited to a hospital setting requiring quick amputations than a battle situation.
Strictly speaking, this would work as an amputation device, but would be sorely suited for battle if the opponents also had access to similar weapons. In that scenario, please refer to Ville Neimi's answer (2 to 4th paragraph) regarding why it would suck as a weapon. Note that in normal use, the Graphene should be strong enough to be reused over and over again. The hexagonal structure of the Graphene ribbon means that even if any edge atoms are lost, it doesn't matter - No matter which atoms you lose, you will always have a suitable cutting edge.
References:
R. R. Nair, M. Sepioni, I-Ling Tsai, O. Lehtinen, J. Keinonen, A. V. Krasheninnikov, T. Thomson, A. K. Geim, I. V. Grigorieva. Spin-half paramagnetism in graphene induced by point defects. Nature Physics, 2012; DOI: 10.1038/nphys2183
http://www.graphenea.com/pages/graphene-properties#.VYCbRkZ8ork
https://en.wikipedia.org/wiki/Graphene#Thermal_conductivity
http://poplab.stanford.edu/pdfs/PopVarshneyRoy-GrapheneThermal-MRSbull12.pdf
https://web.engr.illinois.edu/~aluru/Journals/APL11.pdf
https://en.wikipedia.org/wiki/Bone