You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 06:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Mar 18, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28663211894,19sleep00-21swapper/019:07:170
28639211798,14sleep10-21swapper/119:06:581
287852116105,6sleep20-21swapper/219:08:512
28848210789,12sleep30-21swapper/319:09:393
271182790,1sleep20-21swapper/222:30:212
140352780,0sleep30-21swapper/323:24:383
166062720,0sleep30-21swapper/300:33:563
227072680,0sleep20-21swapper/221:20:042
113512680,1sleep00-21swapper/022:15:010
28902993817,19cyclictest0-21swapper/022:25:110
2890499266,18cyclictest31-21ksoftirqd/219:25:112
2890399221,19cyclictest0-21swapper/120:30:121
2890299221,19cyclictest6652-21ssh22:10:120
54372210,0sleep00-21swapper/022:08:390
2890299210,19cyclictest0-21swapper/000:25:110
70702200,0sleep20-21swapper/221:36:102
28904992017,2cyclictest0-21swapper/200:30:142
2890399200,18cyclictest0-21swapper/123:20:121
2890299201,2cyclictest0-21swapper/021:50:110
2890599191,16cyclictest0-21swapper/321:45:113
2890599171,3cyclictest0-21swapper/300:20:183
2890599170,14cyclictest0-21swapper/322:40:133
28904991714,2cyclictest31427-21kworker/u8:223:43:042
28903991712,2cyclictest27722-21kworker/u8:000:26:011
2890299171,14cyclictest31367-21cut19:15:120
2890599161,3cyclictest0-21swapper/321:05:003
2890599161,3cyclictest0-21swapper/319:15:143
28904991613,2cyclictest29336-21kworker/u8:122:20:042
28904991613,2cyclictest27722-21kworker/u8:000:19:052
28904991613,2cyclictest20262-21kworker/u8:023:01:052
2890399169,5cyclictest221ktimersoftd/100:31:051
28903991611,3cyclictest0-21swapper/123:15:171
2890399161,13cyclictest0-21swapper/119:50:121
2890399160,14cyclictest0-21swapper/123:59:051
2890299161,13cyclictest0-21swapper/020:40:090
2890299160,14cyclictest0-21swapper/019:20:100
2890599152,7cyclictest32108-21ssh23:09:593
2890599151,12cyclictest17470-21ssh22:54:513
2890599150,3cyclictest10181-21switchtime19:41:033
2890599150,13cyclictest0-21swapper/322:30:403
2890499151,2cyclictest0-21swapper/222:03:052
2890499151,2cyclictest0-21swapper/222:03:042
28904991512,2cyclictest9751-21kworker/u8:023:56:012
28904991512,2cyclictest8261-21kworker/u8:121:43:042
28904991512,2cyclictest28931-21kworker/u8:223:12:042
28904991512,2cyclictest28804-21kworker/u8:220:57:052
28904991512,2cyclictest26096-21kworker/u8:022:43:042
28904991512,2cyclictest21347-21kworker/u8:221:28:052
28904991512,2cyclictest20262-21kworker/u8:023:08:012
28904991512,2cyclictest18040-21kworker/u8:120:29:042
28904991512,2cyclictest11311-21kworker/u8:200:38:042
2890499150,11cyclictest0-21swapper/221:46:052
2890499150,10cyclictest0-21swapper/223:50:052
2890499150,10cyclictest0-21swapper/223:35:042
2890399151,3cyclictest24204-21sensors_fan20:16:011
28903991510,3cyclictest3291-21rm22:40:111
2890399150,2cyclictest0-21swapper/122:17:441
2890299153,6cyclictest8804-21copy19:40:000
2890299151,12cyclictest5087-21ssh23:48:270
2890299151,12cyclictest0-21swapper/022:33:310
28902991510,3cyclictest14585-21apt-get23:25:100
28902991510,3cyclictest0-21swapper/019:55:150
28902991510,3cyclictest0-21swapper/000:20:170
73602140,2sleep30-21swapper/323:16:493
2890599141,7cyclictest0-21swapper/300:30:003
28905991411,2cyclictest0-21swapper/321:51:003
28905991410,2cyclictest0-21swapper/321:20:403
2890599140,2cyclictest0-21swapper/321:30:123
2890599140,13cyclictest0-21swapper/321:41:003
2890599140,12cyclictest5449-21ssh22:08:403
2890599140,12cyclictest31157-21sh00:15:153
2890599140,12cyclictest0-21swapper/323:50:513
2890599140,12cyclictest0-21swapper/319:35:043
2890599140,12cyclictest0-21swapper/319:30:103
28904991411,2cyclictest5927-21kworker/u8:020:07:052
28904991411,2cyclictest5927-21kworker/u8:019:22:042
28904991411,2cyclictest31427-21kworker/u8:200:04:012
28904991411,2cyclictest30763-21kworker/u8:219:19:052
28904991411,2cyclictest30763-21kworker/u8:219:14:012
28904991411,2cyclictest2779-21kworker/u8:119:42:052
28904991411,2cyclictest27722-21kworker/u8:000:24:042
2890499141,11cyclictest0-21swapper/221:59:042
2890499141,11cyclictest0-21swapper/221:59:042
2890499140,9cyclictest0-21swapper/219:37:042
2890499140,9cyclictest0-21swapper/200:26:052
2890499140,3cyclictest5498-21modprobe20:50:152
2890499140,2cyclictest0-21swapper/223:19:052
2890499140,13cyclictest0-21swapper/221:50:042
2890499140,12cyclictest0-21swapper/222:19:162
2890499140,12cyclictest0-21swapper/221:32:382
2890499140,12cyclictest0-21swapper/221:15:082
28903991411,2cyclictest0-21swapper/122:34:421
28903991411,2cyclictest0-21swapper/121:27:311
28903991410,3cyclictest0-21swapper/121:42:561
28903991410,3cyclictest0-21swapper/100:15:131
28903991410,2cyclictest207150irq/24-eth122:22:041
28903991410,2cyclictest0-21swapper/123:50:001
28903991410,2cyclictest0-21swapper/121:15:051
2890399140,2cyclictest0-21swapper/123:28:421
2890399140,2cyclictest0-21swapper/121:31:511
2890399140,2cyclictest0-21swapper/121:23:221
2890399140,2cyclictest0-21swapper/121:10:221
2890399140,2cyclictest0-21swapper/120:25:511
2890399140,13cyclictest0-21swapper/123:34:321
2890399140,13cyclictest0-21swapper/122:27:231
2890399140,13cyclictest0-21swapper/120:11:011
2890399140,12cyclictest3728-21runrttasks00:10:041
2890399140,12cyclictest2930-21ssh00:20:061
2890399140,12cyclictest0-21swapper/123:35:451
2890399140,12cyclictest0-21swapper/123:10:001
2890399140,12cyclictest0-21swapper/122:35:141
2890399140,12cyclictest0-21swapper/122:05:151
2890399140,11cyclictest0-21swapper/122:53:121
2890299142,7cyclictest0-21swapper/000:35:010
2890299142,6cyclictest0-21swapper/022:55:010
2890299140,3cyclictest0-21swapper/023:01:260
2890299140,13cyclictest0-21swapper/021:56:540
2890299140,13cyclictest0-21swapper/021:56:530
2890299140,12cyclictest12627-21ssh23:22:280
2890599132,5cyclictest0-21swapper/321:20:003
2890599132,5cyclictest0-21swapper/319:25:003
2890599131,10cyclictest0-21swapper/321:15:003
28905991310,2cyclictest20320-21ssh22:24:133
28905991310,2cyclictest0-21swapper/322:28:103
28905991310,2cyclictest0-21swapper/321:36:203
28905991310,2cyclictest0-21swapper/300:38:163
2890599130,2cyclictest0-21swapper/320:40:003
2890599130,12cyclictest0-21swapper/323:44:163
2890599130,12cyclictest0-21swapper/322:56:003
2890599130,11cyclictest31478-21ssh22:01:273
2890599130,11cyclictest31478-21ssh22:01:273
2890599130,11cyclictest0-21swapper/323:35:203
2890599130,11cyclictest0-21swapper/321:58:503
2890599130,11cyclictest0-21swapper/321:58:493
28904991310,2cyclictest5927-21kworker/u8:019:55:042
28904991310,2cyclictest26096-21kworker/u8:022:45:042
28904991310,2cyclictest18040-21kworker/u8:121:06:012
28904991310,2cyclictest18040-21kworker/u8:120:32:052
28904991310,2cyclictest12722-21diskmemload21:11:182
28904991310,2cyclictest0-21swapper/222:35:592
28904991310,2cyclictest0-21swapper/220:35:152
28904991310,2cyclictest0-21swapper/200:10:092
2890499130,2cyclictest0-21swapper/222:05:042
2890499130,2cyclictest0-21swapper/221:00:042
2890499130,12cyclictest0-21swapper/223:30:122
2890399139,2cyclictest6314-21cut21:35:381
2890399131,7cyclictest3187-21ntpd19:55:011
28903991310,2cyclictest12722-21diskmemload21:46:381
28903991310,2cyclictest0-21swapper/123:02:081
28903991310,2cyclictest0-21swapper/122:58:441
28903991310,2cyclictest0-21swapper/122:11:461
28903991310,2cyclictest0-21swapper/121:58:111
28903991310,2cyclictest0-21swapper/121:58:111
28903991310,2cyclictest0-21swapper/121:50:101
28903991310,2cyclictest0-21swapper/100:36:371
28903991310,2cyclictest0-21swapper/100:00:101
2890399130,2cyclictest0-21swapper/123:50:081
2890399130,2cyclictest0-21swapper/123:40:231
2890399130,12cyclictest0-21swapper/123:06:531
2890399130,12cyclictest0-21swapper/122:00:311
2890399130,12cyclictest0-21swapper/122:00:301
2890299132,6cyclictest8804-21copy19:40:000
2890299132,6cyclictest0-21swapper/023:40:010
2890299132,6cyclictest0-21swapper/021:35:000
2890299131,7cyclictest0-21swapper/020:35:000
2890299131,6cyclictest0-21swapper/020:20:000
2890299131,10cyclictest0-21swapper/023:30:240
2890299131,10cyclictest0-21swapper/020:01:010
28902991310,2cyclictest12722-21diskmemload23:38:010
28902991310,2cyclictest0-21swapper/022:40:340
28902991310,2cyclictest0-21swapper/020:56:030
2890299130,3cyclictest30336-21ssh23:07:190
2890299130,2cyclictest0-21swapper/023:13:330
2890299130,12cyclictest0-21swapper/023:59:230
2890299130,12cyclictest0-21swapper/021:48:030
2890299130,12cyclictest0-21swapper/021:22:530
2890299130,12cyclictest0-21swapper/020:25:150
2890299130,11cyclictest28416-21ssh21:25:140
2890299130,11cyclictest21469-21ssh21:18:300
207862130,2sleep10-21swapper/100:05:021
2890599129,2cyclictest0-21swapper/323:10:393
2890599129,2cyclictest0-21swapper/322:46:533
2890599129,2cyclictest0-21swapper/322:38:013
2890599129,2cyclictest0-21swapper/322:10:343
2890599129,2cyclictest0-21swapper/300:13:553
2890599129,2cyclictest0-21swapper/300:05:343
2890599129,2cyclictest0-21swapper/300:00:193
2890599122,6cyclictest12859-21ssh23:56:013
2890599120,8cyclictest0-21swapper/319:10:593
2890599120,2cyclictest0-21swapper/323:02:213
2890599120,2cyclictest0-21swapper/321:25:563
2890599120,2cyclictest0-21swapper/320:40:113
2890599120,2cyclictest0-21swapper/319:55:133
2890599120,11cyclictest0-21swapper/323:46:363
2890599120,11cyclictest0-21swapper/323:30:143
2890599120,11cyclictest0-21swapper/323:25:323
2890599120,11cyclictest0-21swapper/322:15:153
2890599120,11cyclictest0-21swapper/321:05:173
2890599120,11cyclictest0-21swapper/320:15:133
2890599120,11cyclictest0-21swapper/320:00:143
2890499129,2cyclictest2779-21kworker/u8:119:49:042
2890499129,2cyclictest0-21swapper/223:26:002
2890499129,2cyclictest0-21swapper/222:50:092
2890499129,2cyclictest0-21swapper/219:50:112
28904991210,1cyclictest0-21swapper/200:05:172
2890499120,2cyclictest0-21swapper/222:25:182
2890499120,1cyclictest12722-21diskmemload23:46:032
2890499120,11cyclictest0-21swapper/222:10:122
2890499120,11cyclictest0-21swapper/220:15:122
2890399129,2cyclictest0-21swapper/120:40:371
2890399128,2cyclictest0-21swapper/119:41:011
2890399121,9cyclictest0-21swapper/119:26:021
2890399121,5cyclictest0-21swapper/119:10:001
2890399120,2cyclictest0-21swapper/120:50:151
2890399120,2cyclictest0-21swapper/120:20:151
2890399120,11cyclictest0-21swapper/122:45:341
2890399120,11cyclictest0-21swapper/120:55:511
2890399120,11cyclictest0-21swapper/119:45:111
2890299129,2cyclictest0-21swapper/023:15:200
2890299129,2cyclictest0-21swapper/022:48:310
2890299129,2cyclictest0-21swapper/019:45:170
2890299129,2cyclictest0-21swapper/000:09:520
2890299121,6cyclictest0-21swapper/000:15:000
2890299120,2cyclictest12722-21diskmemload21:10:420
2890299120,2cyclictest0-21swapper/023:52:110
2890299120,2cyclictest0-21swapper/022:50:110
2890299120,2cyclictest0-21swapper/022:21:310
2890299120,2cyclictest0-21swapper/021:44:540
2890299120,2cyclictest0-21swapper/000:03:250
2890299120,11cyclictest983-21ssh22:04:310
2890299120,11cyclictest983-21ssh22:04:310
2890299120,11cyclictest7857-21ssh21:37:240
2890299120,11cyclictest0-21swapper/022:39:410
2890299120,11cyclictest0-21swapper/021:05:140
2890299120,11cyclictest0-21swapper/020:10:180
2890299120,11cyclictest0-21swapper/020:05:170
2890299120,11cyclictest0-21swapper/019:25:110
2890299120,11cyclictest0-21swapper/000:11:280
2890599116,3cyclictest20824-21latency_hist20:10:003
2890599111,6cyclictest0-21swapper/320:20:103
2890599110,2cyclictest0-21swapper/319:25:503
2890599110,10cyclictest0-21swapper/320:25:163
2890499116,3cyclictest17267-21grep20:00:132
2890499112,6cyclictest11367-21ssh23:21:022
2890499112,6cyclictest0-21swapper/219:30:432
2890499110,2cyclictest0-21swapper/220:50:002
2890499110,2cyclictest0-21swapper/220:21:022
2890499110,10cyclictest0-21swapper/222:59:472
2890399118,2cyclictest0-21swapper/119:20:181
2890399112,5cyclictest0-21swapper/119:16:001
2890399110,9cyclictest4880-21munin-node1
2890399110,9cyclictest31112-21munin-node1
2890399110,9cyclictest19516-21grep20:05:141
2890399110,9cyclictest17385-21df_abs20:00:131
2890399110,9cyclictest0-21swapper/121:00:141
2890299118,2cyclictest0-21swapper/000:35:100
2890299116,3cyclictest13233-21tr19:50:120
2890299110,10cyclictest0-21swapper/020:52:330
2890299110,10cyclictest0-21swapper/019:31:010
2890599105,3cyclictest22203-21python20:11:013
2890599100,9cyclictest0-21swapper/320:46:003
2890599100,7cyclictest0-21swapper/319:46:583
2890499100,6cyclictest0-21swapper/220:11:042
2890399100,9cyclictest0-21swapper/121:06:031
2890399100,2cyclictest0-21swapper/119:35:101
2890299105,3cyclictest8896-21packagekitd21:00:040
289059994,3cyclictest7765-21open_files20:55:193
289059994,3cyclictest5336-21fschecks_time20:50:133
289059994,3cyclictest29135-21aten2.4-expect20:30:133
289049990,6cyclictest0-21swapper/220:44:042
289039996,2cyclictest0-21swapper/120:45:171
289029994,3cyclictest3728-21runrttasks20:46:080
289029994,3cyclictest25947-21ntp_kernel_pll_20:20:170
289029992,5cyclictest31112-21munin-node0
289029990,7cyclictest30485-21unixbench_multi19:11:010
289059983,3cyclictest13443-21fschecks_count19:50:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional