AbstractThe Standard Model has been a successful theory in various aspects. It predicted and led to discovery of many new particles, including the Higgs boson recently found, the last missing piece of the Standard Model. The Higgs mechanism allows the vector bosons and fermions to be massive via the electroweak symmetry breaking. This thesis presents the search of the Standard Model Higgs through the decay products: one muon, one hadronically decaying tau, and two or more jets using the full 9.7 fb^(-1) of Tevatron collider RunII data set collected in the D0 detector at Fermilab. The main production channels are gluon-gluon fusion, vector boson fusion, and Higgs production associated with a W/Z boson. No evidence of the Standard Model Higgs boson is observed in these channels with hypothesized Higgs mass between 105 GeV and 150 GeV, but the data do not exclude it either. We set the upper limits on the ratio of the 95% CL exclusion to the SM Higgs cross section. Combining with other analyses in Tevatron, the Higgs mass is ruled out at 95% confidence level between 147 and 180 GeV, and a 2.9 excess of events indicates a Higgs boson possibly lies in the mass range from 115 to 140 GeV.