he doesn’t scare me

There are 3 persons in the story below.  One is our group leader (Japanese), another is a male colleague (Japanese), and yours truly.  We are all subcontractual employees in the company I am reporting to, everyday for almost a year now.  Colleague, reports to work at our agent’s office most of the time though.

Yesterday, colleague came over to fix something that needs Leader’s supervision.  While Leader was on a meeting, Colleague was debugging beside me.  Suddenly he asked me,
Colleague:    How are you doing?
Me:        Fine, Why?
Colleague:    Aren’t you scared?  Leader shouts.  Frequently.
Me:        (Smiling).  No, of course not.  When he shouts, we shout back.
Colleague:    Really?  He’s really hot-tempered, right?
Me:        Yep.  But he can’t do so much shouting.  We are never scared of him.

Officemate(Japanese) in front of me was smiling with me.

He doesn’t scare me. He makes me shiver. In ANGER.