You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-27 - 04:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed May 27, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3998211895,18sleep10-21swapper/119:06:361
4286211493,16sleep00-21swapper/019:09:280
3539210998,6sleep20-21swapper/219:06:002
4107210888,15sleep30-21swapper/319:08:023
187682730,0sleep10-21swapper/122:49:031
163742690,0sleep00-21swapper/021:38:510
79412550,0sleep30-21swapper/319:16:033
436999360,18cyclictest0-21swapper/123:05:131
436899280,1cyclictest0-21swapper/019:30:110
437199211,2cyclictest0-21swapper/320:35:123
437199200,18cyclictest0-21swapper/321:55:113
437099202,6cyclictest0-21swapper/220:57:592
437099200,18cyclictest0-21swapper/219:25:112
436999200,2cyclictest0-21swapper/100:00:121
4371991915,2cyclictest8322-21kworker/u8:022:23:043
436999191,16cyclictest0-21swapper/123:15:111
436999191,16cyclictest0-21swapper/100:35:121
4371991815,2cyclictest26767-21kworker/u8:221:17:053
437099180,2cyclictest0-21swapper/221:10:122
436899180,16cyclictest0-21swapper/022:35:100
436899180,16cyclictest0-21swapper/021:30:130
4371991714,2cyclictest6751-21kworker/u8:123:12:053
4371991714,2cyclictest25950-21kworker/u8:023:44:063
4371991714,2cyclictest21670-21kworker/u8:200:18:063
4371991713,3cyclictest30163-21ssh23:34:433
437099172,7cyclictest0-21swapper/221:19:582
437099171,3cyclictest18532-21wc00:30:002
4370991713,2cyclictest0-21swapper/222:00:122
436899170,2cyclictest0-21swapper/021:10:120
4371991613,2cyclictest6941-21kworker/u8:021:54:053
4371991613,2cyclictest6941-21kworker/u8:021:41:043
4371991613,2cyclictest367-21kworker/u8:320:33:043
4371991613,2cyclictest26767-21kworker/u8:221:38:053
4371991613,2cyclictest17284-21kworker/u8:222:47:043
4371991613,2cyclictest14907-21kworker/u8:023:23:043
4371991613,2cyclictest12884-21kworker/u8:023:54:053
4371991613,2cyclictest10332-21kworker/u8:219:28:023
437199161,13cyclictest12423-21ssh00:23:013
437199160,11cyclictest0-21swapper/320:47:043
437099161,13cyclictest0-21swapper/200:05:172
436899160,15cyclictest0-21swapper/022:00:110
437199151,3cyclictest21489-21ssh23:59:013
4371991512,2cyclictest9449-21kworker/u8:000:25:043
4371991512,2cyclictest8020-21kworker/u8:122:39:043
4371991512,2cyclictest565-21kworker/u8:022:33:043
4371991512,2cyclictest367-21kworker/u8:320:24:043
4371991512,2cyclictest2990-21kworker/u8:222:10:043
4371991512,2cyclictest24393-21kworker/u8:120:19:053
4371991512,2cyclictest20277-21kworker/u8:020:03:053
4371991512,2cyclictest17284-21kworker/u8:222:53:053
4371991512,2cyclictest1215-21kworker/u8:100:04:043
437199151,12cyclictest31343-21modprobe23:35:153
437199150,13cyclictest1039-21ssh21:22:413
437199150,13cyclictest0-21swapper/322:25:203
437199150,13cyclictest0-21swapper/320:55:203
437099151,12cyclictest16827-21perl23:20:132
4370991510,3cyclictest2865-21ssh00:13:242
4370991510,3cyclictest0-21swapper/220:05:002
437099150,4cyclictest0-21swapper/221:36:012
437099150,3cyclictest0-21swapper/223:00:052
437099150,1cyclictest0-21swapper/219:30:102
437099150,13cyclictest26044-21sh00:36:482
437099150,13cyclictest0-21swapper/223:26:022
436899152,11cyclictest0-21swapper/021:43:030
436899151,13cyclictest4367-21cyclictest22:55:120
4368991510,3cyclictest28104-21ssh22:25:110
436899150,3cyclictest21396-21switchtime22:51:030
35002150,0sleep20-21swapper/222:32:442
437199149,3cyclictest5704-21ssh23:09:043
437199149,3cyclictest27703-21cat00:05:173
4371991411,2cyclictest2990-21kworker/u8:222:07:043
4371991411,2cyclictest2990-21kworker/u8:222:00:053
4371991411,2cyclictest19997-21kworker/u8:121:49:043
4371991411,2cyclictest13714-21kworker/u8:122:17:053
4371991411,2cyclictest1215-21kworker/u8:123:48:043
437199140,2cyclictest0-21swapper/321:27:483
437199140,2cyclictest0-21swapper/321:27:473
437199140,13cyclictest0-21swapper/319:21:013
437099149,3cyclictest0-21swapper/222:48:012
437099149,3cyclictest0-21swapper/221:33:522
4370991411,2cyclictest0-21swapper/223:51:432
4370991411,2cyclictest0-21swapper/221:57:522
437099140,2cyclictest0-21swapper/223:38:132
437099140,13cyclictest0-21swapper/222:21:022
437099140,12cyclictest5526-21aten2.4_r3power22:35:112
437099140,12cyclictest3649-21snmpd00:21:452
436999149,3cyclictest3643-21turbostat22:04:551
436999149,3cyclictest30292-21ntp_states23:00:171
436999140,13cyclictest0-21swapper/123:58:191
436999140,12cyclictest0-21swapper/122:27:081
436999140,11cyclictest0-21swapper/123:43:081
436899141,11cyclictest6657-21ssh21:28:400
436899141,11cyclictest6657-21ssh21:28:400
4368991410,2cyclictest0-21swapper/019:16:020
436899140,3cyclictest19655-21rm23:56:100
436899140,13cyclictest0-21swapper/020:40:290
436899140,12cyclictest10081-21ssh23:46:140
436899140,12cyclictest0-21swapper/023:41:000
436899140,12cyclictest0-21swapper/022:49:380
436899140,12cyclictest0-21swapper/021:16:010
436899140,12cyclictest0-21swapper/000:10:060
437199139,3cyclictest27965-21ssh00:39:493
437199132,6cyclictest0-21swapper/321:05:003
4371991310,2cyclictest26539-21kworker/u8:220:10:043
4371991310,2cyclictest21670-21kworker/u8:200:10:043
4371991310,2cyclictest18176-21kworker/u8:319:55:043
4371991310,2cyclictest18176-21kworker/u8:319:52:053
4371991310,2cyclictest16326-21kworker/u8:121:12:043
4371991310,2cyclictest0-21swapper/322:42:323
437199130,8cyclictest0-21swapper/323:00:043
437199130,8cyclictest0-21swapper/319:47:043
437199130,2cyclictest22075-21sh23:25:183
437199130,2cyclictest0-21swapper/321:05:193
437199130,12cyclictest0-21swapper/320:25:013
437199130,12cyclictest0-21swapper/319:11:013
437099138,3cyclictest18690-21grep22:15:122
437099138,3cyclictest0-21swapper/219:40:132
437099138,3cyclictest0-21swapper/219:35:122
437099131,7cyclictest18201-21ssh22:15:002
4370991310,2cyclictest12254-21ssh23:49:382
4370991310,2cyclictest11618-21ssh22:41:002
4370991310,2cyclictest11359-21ssh22:06:502
4370991310,2cyclictest0-21swapper/223:32:442
4370991310,2cyclictest0-21swapper/222:56:032
4370991310,2cyclictest0-21swapper/222:51:362
4370991310,2cyclictest0-21swapper/221:45:262
4370991310,2cyclictest0-21swapper/221:29:262
4370991310,2cyclictest0-21swapper/221:29:252
4370991310,2cyclictest0-21swapper/220:30:212
4370991310,2cyclictest0-21swapper/220:21:062
4370991310,2cyclictest0-21swapper/219:20:002
4370991310,2cyclictest0-21swapper/200:00:132
437099130,2cyclictest0-21swapper/223:55:282
437099130,2cyclictest0-21swapper/222:28:442
437099130,2cyclictest0-21swapper/221:50:292
437099130,2cyclictest0-21swapper/219:50:182
437099130,12cyclictest0-21swapper/223:40:542
437099130,12cyclictest0-21swapper/223:11:252
437099130,12cyclictest0-21swapper/223:05:012
437099130,11cyclictest0-21swapper/200:32:312
436999131,10cyclictest0-21swapper/120:00:151
4369991310,2cyclictest0-21swapper/123:33:101
4369991310,2cyclictest0-21swapper/121:48:391
436999130,2cyclictest14236-21cut23:50:501
436999130,2cyclictest0-21swapper/122:56:031
436999130,2cyclictest0-21swapper/122:20:171
436999130,2cyclictest0-21swapper/100:18:591
436999130,11cyclictest0-21swapper/123:20:041
436999130,11cyclictest0-21swapper/122:05:281
436999130,11cyclictest0-21swapper/120:05:201
436899138,3cyclictest0-21swapper/019:45:100
4368991310,2cyclictest0-21swapper/023:05:180
4368991310,2cyclictest0-21swapper/022:41:500
4368991310,2cyclictest0-21swapper/021:50:290
4368991310,2cyclictest0-21swapper/019:55:160
436899130,2cyclictest9852-21ssh23:13:020
436899130,12cyclictest0-21swapper/023:20:100
436899130,12cyclictest0-21swapper/022:15:100
436899130,12cyclictest0-21swapper/000:00:090
436899130,11cyclictest20534-21diskmemload00:35:160
436899130,11cyclictest0-21swapper/023:00:140
436899130,11cyclictest0-21swapper/000:16:500
21312130,2sleep10-21swapper/100:12:171
437199129,2cyclictest24393-21kworker/u8:120:06:043
437199129,2cyclictest0-21swapper/321:30:093
437199127,3cyclictest17578-21ntpdc19:40:173
437199120,2cyclictest12745-21ssh23:15:423
437199120,2cyclictest0-21swapper/319:31:013
437199120,11cyclictest0-21swapper/322:56:103
437199120,11cyclictest0-21swapper/300:31:083
437099129,2cyclictest0-21swapper/223:15:102
437099129,2cyclictest0-21swapper/200:16:042
437099122,7cyclictest0-21swapper/220:11:012
437099122,7cyclictest0-21swapper/219:24:582
437099120,11cyclictest0-21swapper/221:40:072
437099120,11cyclictest0-21swapper/221:21:162
437099120,11cyclictest0-21swapper/221:05:202
437099120,11cyclictest0-21swapper/220:15:142
437099120,11cyclictest0-21swapper/220:05:192
437099120,11cyclictest0-21swapper/219:55:112
436999129,2cyclictest0-21swapper/123:35:131
436999129,2cyclictest0-21swapper/123:25:141
436999129,2cyclictest0-21swapper/122:54:371
436999129,2cyclictest0-21swapper/121:13:391
436999129,2cyclictest0-21swapper/121:05:301
436999129,2cyclictest0-21swapper/100:21:101
436999128,2cyclictest0-21swapper/100:05:201
436999127,3cyclictest17984-21fschecks_time21:40:141
436999127,3cyclictest0-21swapper/121:00:141
436999127,3cyclictest0-21swapper/120:25:131
436999127,3cyclictest0-21swapper/120:10:141
436999121,9cyclictest3434-21perl21:25:151
436999121,9cyclictest3434-21perl21:25:141
436999121,9cyclictest31948-21df21:55:121
436999121,9cyclictest0-21swapper/120:50:131
436999121,9cyclictest0-21swapper/119:56:011
436999121,3cyclictest0-21swapper/121:15:501
436999121,3cyclictest0-21swapper/120:36:031
436999121,3cyclictest0-21swapper/119:30:151
436999120,2cyclictest0-21swapper/123:10:301
436999120,2cyclictest0-21swapper/122:35:521
436999120,2cyclictest0-21swapper/122:15:231
436999120,2cyclictest0-21swapper/122:12:211
436999120,2cyclictest0-21swapper/121:50:201
436999120,2cyclictest0-21swapper/121:31:191
436999120,11cyclictest20534-21diskmemload21:39:591
436999120,11cyclictest0-21swapper/123:45:101
436999120,11cyclictest0-21swapper/122:40:011
436999120,11cyclictest0-21swapper/122:34:481
436999120,11cyclictest0-21swapper/100:33:371
436999120,10cyclictest0-21swapper/100:27:181
436899129,2cyclictest0-21swapper/022:30:250
436899129,2cyclictest0-21swapper/019:36:020
436899129,2cyclictest0-21swapper/000:09:080
436899120,3cyclictest0-21swapper/023:54:450
436899120,2cyclictest12204-21ssh00:22:410
436899120,2cyclictest0-21swapper/023:35:180
436899120,2cyclictest0-21swapper/023:30:530
436899120,2cyclictest0-21swapper/023:15:060
436899120,2cyclictest0-21swapper/021:47:230
436899120,2cyclictest0-21swapper/021:00:170
436899120,2cyclictest0-21swapper/019:25:170
436899120,1cyclictest0-21swapper/020:30:140
436899120,11cyclictest10512-21ssh22:06:000
436899120,11cyclictest0-21swapper/023:26:540
436899120,11cyclictest0-21swapper/022:10:230
436899120,11cyclictest0-21swapper/021:56:030
436899120,11cyclictest0-21swapper/019:50:140
436899120,11cyclictest0-21swapper/019:21:020
303992120,2sleep00-21swapper/021:20:050
212852120,2sleep00-21swapper/000:31:520
147442120,2sleep00-21swapper/000:25:150
437199118,2cyclictest367-21kworker/u8:320:40:023
437099118,2cyclictest0-21swapper/219:45:152
436999118,2cyclictest19285-21smartctl19:45:121
436999111,8cyclictest9172-21perl19:20:141
436999111,3cyclictest30807-21munin-node1
436999111,2cyclictest14670-21apt-get19:35:101
436999111,2cyclictest10689-21apt-get20:45:101
436999110,9cyclictest0-21swapper/119:40:131
436999110,9cyclictest0-21swapper/119:16:021
436999110,3cyclictest32607-21apt-get20:20:041
436899112,5cyclictest0-21swapper/020:20:000
436899111,5cyclictest0-21swapper/020:50:000
436899111,5cyclictest0-21swapper/020:05:010
436899110,10cyclictest0-21swapper/022:20:500
436899110,10cyclictest0-21swapper/020:36:260
437199107,2cyclictest6215-21kworker/u8:020:50:053
437099105,3cyclictest14482-21cron20:55:002
437099102,7cyclictest0-21swapper/220:27:012
436999107,2cyclictest5771-21smartctl19:11:011
436999105,3cyclictest31072-21grep21:20:151
436999101,7cyclictest0-21swapper/119:50:111
436999100,9cyclictest8677-21munin-node1
436999100,7cyclictest0-21swapper/120:56:591
436999100,2cyclictest0-21swapper/119:25:111
436899104,2cyclictest24518-21apt-get20:00:040
43709994,3cyclictest8683-21dpkg20:40:112
43709994,3cyclictest7549-21sh20:35:182
43709994,3cyclictest6488-21latency_hist19:14:592
43709994,3cyclictest10686-21munin-node2
43699990,8cyclictest0-21swapper/120:30:191
43689994,3cyclictest4952-21df_abs19:10:130
43689994,3cyclictest20097-21timerwakeupswit21:06:030
43689994,3cyclictest17546-21sed19:40:170
43689994,3cyclictest1287-21ntpdc20:20:200
43719983,3cyclictest14695-21aten2.4_r3power19:35:113
43709983,3cyclictest17239-21grep21:00:152
43689983,3cyclictest3728-21runrttasks20:25:050
43689983,3cyclictest29403-21cat20:10:150
43689983,3cyclictest14743-21aten2.4_r3power20:55:130
43689983,3cyclictest10841-21aten2.4-expect20:45:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional