You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 13:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Sun Nov 30, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7465211699,12sleep20-21swapper/219:07:092
7357211595,15sleep00-21swapper/019:05:480
7538211296,11sleep10-21swapper/119:08:041
7355210796,6sleep30-21swapper/319:05:463
204672800,1sleep10-21swapper/121:40:171
138172750,0sleep10-21swapper/122:07:351
180142680,0sleep10-21swapper/123:55:181
180142680,0sleep10-21swapper/123:55:181
237372610,3sleep1771799cyclictest00:01:031
771699259,14cyclictest0-21swapper/020:35:120
771899221,19cyclictest5798-21ssh21:25:122
771899221,19cyclictest0-21swapper/220:55:132
771899211,18cyclictest0-21swapper/200:10:142
771699210,19cyclictest0-21swapper/019:45:140
7716992017,2cyclictest10897-21kworker/u8:022:57:040
771699200,18cyclictest0-21swapper/020:20:130
7719991916,2cyclictest30230-21kworker/u8:000:09:043
7719991916,2cyclictest27437-21kworker/u8:121:54:013
7719991916,2cyclictest14146-21kworker/u8:123:49:043
7718991913,4cyclictest14018-21stty19:25:122
771899191,16cyclictest0-21swapper/221:20:132
771899190,2cyclictest0-21swapper/223:35:112
7717991916,2cyclictest6218-21kworker/u8:022:04:041
7719991815,2cyclictest9581-21kworker/u8:021:35:043
7719991815,2cyclictest6218-21kworker/u8:022:22:043
7719991815,2cyclictest16726-21kworker/u8:221:46:043
7719991815,2cyclictest14277-21kworker/u8:200:00:043
7719991815,2cyclictest10897-21kworker/u8:023:19:043
771999180,2cyclictest0-21swapper/322:04:053
771899180,16cyclictest0-21swapper/223:20:122
7716991815,2cyclictest9581-21kworker/u8:021:32:040
7716991815,2cyclictest9581-21kworker/u8:021:32:040
7719991714,2cyclictest6218-21kworker/u8:022:14:043
7719991714,2cyclictest28706-21kworker/u8:121:31:043
7719991714,2cyclictest28706-21kworker/u8:121:31:043
7719991714,2cyclictest14277-21kworker/u8:223:59:043
7719991714,2cyclictest14277-21kworker/u8:223:59:043
7719991713,3cyclictest14146-21kworker/u8:123:44:043
7716991713,2cyclictest16726-21kworker/u8:221:47:040
771699170,15cyclictest0-21swapper/021:54:050
771999161,3cyclictest7654-21ntp_states22:35:183
771999161,3cyclictest4618-21ssh00:15:243
7719991613,2cyclictest9922-21kworker/u8:021:12:043
7719991613,2cyclictest3487-21kworker/u8:200:23:043
7719991613,2cyclictest32413-21kworker/u8:221:57:043
7719991613,2cyclictest29718-21kworker/u8:122:30:053
7719991613,2cyclictest26069-21kworker/u8:023:34:043
7719991613,2cyclictest19559-21kworker/u8:020:20:043
7719991613,2cyclictest1851-21kworker/u8:119:39:043
7719991613,2cyclictest11147-21kworker/u8:000:36:053
7719991613,2cyclictest10897-21kworker/u8:023:03:043
771999161,13cyclictest3227-21ssh21:21:353
771999161,13cyclictest23135-21ssh21:43:203
771999161,13cyclictest0-21swapper/319:15:173
771899163,11cyclictest0-21swapper/222:53:162
771899161,4cyclictest11898-21ssh23:15:112
7718991613,2cyclictest0-21swapper/222:24:392
7718991611,3cyclictest11084-21fw_packets21:30:162
7718991611,3cyclictest11084-21fw_packets21:30:152
7718991611,3cyclictest0-21swapper/223:25:502
771899161,13cyclictest0-21swapper/222:15:162
7716991613,2cyclictest28706-21kworker/u8:121:24:050
7716991613,2cyclictest22083-21kworker/u8:220:07:040
7716991613,2cyclictest14146-21kworker/u8:100:18:040
7716991613,2cyclictest14146-21kworker/u8:100:05:040
7719991512,2cyclictest9922-21kworker/u8:020:57:043
7719991512,2cyclictest7444-21kworker/u8:321:26:043
7719991512,2cyclictest6218-21kworker/u8:022:08:043
7719991512,2cyclictest5944-21kworker/u8:220:39:043
7719991512,2cyclictest5149-21kworker/u8:223:10:013
7719991512,2cyclictest3487-21kworker/u8:200:26:043
7719991512,2cyclictest31838-21kworker/u8:019:11:043
7719991512,2cyclictest30230-21kworker/u8:000:14:043
7719991512,2cyclictest22083-21kworker/u8:220:09:043
7719991512,2cyclictest19559-21kworker/u8:019:54:053
7719991512,2cyclictest1361-21kworker/u8:120:29:043
7719991512,2cyclictest10897-21kworker/u8:022:54:053
771999151,12cyclictest0-21swapper/319:25:153
771999150,13cyclictest0-21swapper/322:56:363
771899152,7cyclictest15418-21ssh22:10:012
771899152,6cyclictest0-21swapper/222:41:312
771899152,3cyclictest31293-21sh22:25:382
771899152,2cyclictest23838-21diskmemload21:52:362
771899151,3cyclictest7113-21ssh23:44:302
7718991512,2cyclictest23838-21diskmemload21:49:152
7718991511,3cyclictest27627-21gzip00:05:242
771899151,12cyclictest25893-21apt-get23:30:102
771899151,12cyclictest0-21swapper/223:09:462
771899150,13cyclictest0-21swapper/200:39:202
7717991512,2cyclictest23838-21diskmemload21:24:461
7717991512,2cyclictest23838-21diskmemload00:08:251
7717991512,2cyclictest19559-21kworker/u8:019:48:041
7717991512,2cyclictest0-21swapper/122:40:251
771799150,2cyclictest0-21swapper/123:10:561
771799150,13cyclictest0-21swapper/122:32:551
771799150,13cyclictest0-21swapper/100:10:251
7716991512,2cyclictest9922-21kworker/u8:021:14:010
7716991512,2cyclictest5149-21kworker/u8:223:11:040
7716991512,2cyclictest5149-21kworker/u8:223:08:050
7716991512,2cyclictest5058-21kworker/u8:222:41:050
7716991512,2cyclictest32413-21kworker/u8:221:56:050
7716991512,2cyclictest14277-21kworker/u8:223:51:040
771699150,13cyclictest17364-21wc00:30:010
771699150,13cyclictest0-21swapper/023:40:270
771699150,13cyclictest0-21swapper/000:20:070
139292150,0sleep00-21swapper/023:16:120
7719991411,2cyclictest5149-21kworker/u8:223:09:043
7719991411,2cyclictest5058-21kworker/u8:222:44:043
7719991411,2cyclictest19140-21kworker/u8:223:25:053
7719991411,2cyclictest1851-21kworker/u8:119:45:043
7719991411,2cyclictest1851-21kworker/u8:119:41:043
7719991411,2cyclictest1361-21kworker/u8:120:31:043
7719991411,2cyclictest10897-21kworker/u8:023:21:043
7719991411,2cyclictest0-21swapper/322:15:043
771999140,13cyclictest0-21swapper/323:52:463
771999140,13cyclictest0-21swapper/321:15:063
771999140,13cyclictest0-21swapper/300:30:063
771999140,12cyclictest32368-21ssh23:35:433
771999140,12cyclictest0-21swapper/319:30:153
771899149,3cyclictest23838-21diskmemload23:50:532
771899149,3cyclictest18759-21rm23:55:352
771899149,3cyclictest18759-21rm23:55:352
771899142,7cyclictest0-21swapper/220:05:002
771899142,7cyclictest0-21swapper/219:35:002
771899142,7cyclictest0-21swapper/219:10:012
771899142,11cyclictest0-21swapper/223:11:522
771899141,2cyclictest0-21swapper/221:17:282
7718991411,2cyclictest0-21swapper/221:42:482
7718991411,2cyclictest0-21swapper/200:31:572
7718991410,3cyclictest23838-21diskmemload00:00:182
771899140,13cyclictest0-21swapper/223:45:202
771899140,12cyclictest0-21swapper/222:05:282
7717991411,2cyclictest0-21swapper/123:37:151
7717991411,2cyclictest0-21swapper/121:53:151
7717991411,2cyclictest0-21swapper/121:10:451
7717991411,2cyclictest0-21swapper/100:19:551
7717991410,2cyclictest0-21swapper/120:25:051
771799140,2cyclictest0-21swapper/123:21:251
771799140,13cyclictest0-21swapper/123:18:161
771799140,13cyclictest0-21swapper/122:25:551
771799140,13cyclictest0-21swapper/122:20:251
771799140,13cyclictest0-21swapper/121:46:551
771799140,13cyclictest0-21swapper/121:31:051
771799140,13cyclictest0-21swapper/121:31:051
771799140,13cyclictest0-21swapper/119:40:261
771799140,12cyclictest0-21swapper/123:25:171
771799140,12cyclictest0-21swapper/122:45:271
771799140,12cyclictest0-21swapper/121:35:581
771699149,3cyclictest0-21swapper/000:01:530
7716991411,2cyclictest5058-21kworker/u8:222:34:010
7716991411,2cyclictest19559-21kworker/u8:020:25:040
7716991411,2cyclictest19516-21kworker/u8:123:01:040
7716991411,2cyclictest1851-21kworker/u8:119:36:040
7716991410,2cyclictest8187-21ssh22:01:020
7716991410,2cyclictest17043-21ssh22:45:200
7716991410,2cyclictest0-21swapper/023:30:220
771699140,3cyclictest19209-21ssh23:22:120
771699140,2cyclictest0-21swapper/022:06:150
771699140,13cyclictest0-21swapper/000:31:530
771699140,12cyclictest541-21ssh23:36:470
771699140,12cyclictest23838-21diskmemload22:15:480
771699140,12cyclictest0-21swapper/021:36:030
7719991310,2cyclictest5058-21kworker/u8:222:45:043
7719991310,2cyclictest31838-21kworker/u8:019:20:043
7719991310,2cyclictest15492-21kworker/u8:221:02:043
7719991310,2cyclictest0-21swapper/320:15:143
771999130,2cyclictest0-21swapper/322:28:313
771999130,2cyclictest0-21swapper/320:05:003
771899139,3cyclictest0-21swapper/222:36:372
771899138,3cyclictest6287-21ssh22:00:142
771899134,7cyclictest4021-21sed20:20:152
771899132,7cyclictest0-21swapper/220:50:002
771899132,6cyclictest0-21swapper/221:00:002
771899132,10cyclictest0-21swapper/220:35:252
771899131,2cyclictest0-21swapper/220:05:272
7718991310,2cyclictest301ktimersoftd/222:46:022
771899130,2cyclictest0-21swapper/200:28:502
771899130,12cyclictest0-21swapper/221:35:142
771899130,11cyclictest0-21swapper/222:30:042
771799139,3cyclictest11147-21kworker/u8:000:32:041
771799131,11cyclictest23838-21diskmemload21:17:291
7717991310,2cyclictest3487-21kworker/u8:200:35:041
7717991310,2cyclictest31838-21kworker/u8:019:24:041
7717991310,2cyclictest23838-21diskmemload22:57:251
7717991310,2cyclictest19516-21kworker/u8:123:06:041
7717991310,2cyclictest0-21swapper/123:50:351
7717991310,2cyclictest0-21swapper/120:50:191
771799130,2cyclictest0-21swapper/122:50:551
771799130,2cyclictest0-21swapper/100:23:051
771799130,1cyclictest0-21swapper/121:56:251
771799130,12cyclictest0-21swapper/122:39:001
771799130,12cyclictest0-21swapper/121:00:201
771799130,11cyclictest14295-21df19:25:141
771799130,11cyclictest0-21swapper/120:10:231
771699131,11cyclictest0-21swapper/023:29:270
7716991310,2cyclictest6218-21kworker/u8:022:21:040
7716991310,2cyclictest31838-21kworker/u8:019:25:040
7716991310,2cyclictest29718-21kworker/u8:122:27:040
7716991310,2cyclictest23838-21diskmemload21:28:020
7716991310,2cyclictest14019-21kworker/u8:219:30:050
771699130,2cyclictest0-21swapper/023:55:300
771699130,2cyclictest0-21swapper/023:55:300
771699130,2cyclictest0-21swapper/000:14:510
771699130,12cyclictest10164-21ssh23:46:500
771699130,12cyclictest0-21swapper/021:19:200
771699130,12cyclictest0-21swapper/020:00:290
771699130,12cyclictest0-21swapper/000:35:000
771699130,11cyclictest0-21swapper/022:51:520
771699130,11cyclictest0-21swapper/021:41:560
771999129,2cyclictest15492-21kworker/u8:220:53:043
771899129,2cyclictest23838-21diskmemload22:56:222
771899129,2cyclictest0-21swapper/223:01:172
771899129,2cyclictest0-21swapper/221:11:352
771899122,8cyclictest7297-21grep20:25:262
771899122,7cyclictest0-21swapper/219:18:022
771899121,7cyclictest0-21swapper/220:41:082
771899120,2cyclictest0-21swapper/219:35:262
771899120,2cyclictest0-21swapper/200:20:022
771899120,11cyclictest0-21swapper/221:55:172
771899120,10cyclictest0-21swapper/200:15:452
771799129,2cyclictest31838-21kworker/u8:019:18:021
771799129,2cyclictest19559-21kworker/u8:019:50:041
771799129,2cyclictest1851-21kworker/u8:119:10:041
771799129,2cyclictest15492-21kworker/u8:220:47:041
771799129,2cyclictest0-21swapper/120:09:281
771799120,2cyclictest0-21swapper/122:15:151
771799120,2cyclictest0-21swapper/122:10:181
771799120,2cyclictest0-21swapper/120:05:001
771799120,2cyclictest0-21swapper/119:35:211
771799120,2cyclictest0-21swapper/119:30:181
771799120,11cyclictest0-21swapper/123:46:591
771799120,11cyclictest0-21swapper/123:01:551
771799120,11cyclictest0-21swapper/121:26:281
771799120,11cyclictest0-21swapper/120:55:171
771699129,2cyclictest31838-21kworker/u8:019:13:040
771699129,2cyclictest0-21swapper/022:35:140
771699123,6cyclictest0-21swapper/021:06:580
771699122,7cyclictest0-21swapper/020:46:010
771699122,7cyclictest0-21swapper/019:21:010
771699120,2cyclictest0-21swapper/020:55:000
771699120,11cyclictest0-21swapper/022:10:370
771699120,11cyclictest0-21swapper/020:40:000
771699120,11cyclictest0-21swapper/020:15:220
771699120,11cyclictest0-21swapper/020:10:150
57672120,2sleep10-21swapper/123:42:211
150882120,2sleep10-21swapper/100:26:291
771999118,2cyclictest5944-21kworker/u8:220:40:053
771999118,2cyclictest22083-21kworker/u8:220:11:043
771999118,2cyclictest19559-21kworker/u8:019:56:053
771899113,6cyclictest0-21swapper/220:11:022
771899110,6cyclictest0-21swapper/220:55:002
771799118,2cyclictest9922-21kworker/u8:021:06:041
771799118,2cyclictest19559-21kworker/u8:020:22:011
771799118,2cyclictest19559-21kworker/u8:020:19:041
771799118,2cyclictest19559-21kworker/u8:019:57:041
771799118,2cyclictest0-21swapper/123:30:121
771799110,9cyclictest0-21swapper/120:35:131
771699118,2cyclictest31838-21kworker/u8:019:16:040
771699118,2cyclictest19559-21kworker/u8:019:55:050
771699118,2cyclictest15492-21kworker/u8:220:54:040
771699118,2cyclictest0-21swapper/019:40:140
771699110,9cyclictest0-21swapper/020:30:150
211202110,1sleep2301ktimersoftd/219:40:262
771999100,2cyclictest0-21swapper/320:47:043
771899107,2cyclictest0-21swapper/219:45:202
771899103,5cyclictest9279-21grep20:30:272
771899103,5cyclictest27378-21munin-node2
771899103,5cyclictest24334-21tr19:50:142
771899103,5cyclictest22358-21df_abs21:05:162
771899103,5cyclictest1947-21tr20:15:142
771899103,5cyclictest13356-21grep19:20:262
771699107,2cyclictest0-21swapper/021:00:250
771699106,3cyclictest24140-21aten2.4_r3power19:50:130
77199994,3cyclictest22320-21tr21:05:173
77179996,2cyclictest13404-21kworker/u8:120:41:041
77179990,2cyclictest0-21swapper/120:33:371
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional