You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 01:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Mon Jul 13, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
292702121110,6sleep20-21swapper/219:05:462
2619121180,4sleep13002899cyclictest20:20:121
29765211594,16sleep00-21swapper/019:06:570
29838210897,6sleep10-21swapper/119:07:541
29940210594,6sleep30-21swapper/319:09:113
278182810,1sleep1221ktimersoftd/122:31:041
183072770,0sleep00-21swapper/022:21:050
19112740,0sleep00-21swapper/000:20:260
34602660,1sleep30-21swapper/323:14:313
163822630,4sleep23002999cyclictest00:35:322
30028993817,19cyclictest0-21swapper/120:55:141
235262250,0sleep00-21swapper/023:00:420
200902240,0sleep10-21swapper/121:50:121
3003099211,2cyclictest0-21swapper/320:55:133
30030992015,3cyclictest3013-21ssh22:40:113
3003099200,2cyclictest0-21swapper/300:25:113
3003099200,18cyclictest0-21swapper/321:55:133
9492180,0sleep10-21swapper/122:03:511
3003099181,14cyclictest0-21swapper/323:36:053
3002899180,3cyclictest0-21swapper/122:25:161
3002899180,16cyclictest0-21swapper/119:25:111
227392180,0sleep30-21swapper/323:35:003
245152170,0sleep00-21swapper/021:20:180
3003099162,8cyclictest3262-21avahi-daemon00:20:003
3003099161,13cyclictest29139-21wc20:25:183
3003099161,13cyclictest15116-21date21:45:003
30030991611,3cyclictest0-21swapper/322:15:143
3003099160,13cyclictest0-21swapper/323:49:503
3002999161,13cyclictest30248-21apt-get19:10:122
3002799161,13cyclictest3728-21runrttasks21:27:290
3003099151,3cyclictest812-21python20:36:023
30030991510,3cyclictest0-21swapper/322:27:453
3003099150,13cyclictest22342-21ssh21:18:353
3002999150,13cyclictest20842-21sed21:50:172
3002999150,13cyclictest12036-21latency_hist19:45:002
3002999150,13cyclictest0-21swapper/222:30:112
30028991512,2cyclictest18118-21kworker/u8:200:38:041
3002899150,13cyclictest0-21swapper/123:34:411
3002799151,3cyclictest0-21swapper/023:56:030
3002799151,13cyclictest3728-21runrttasks21:32:190
3002799150,2cyclictest14072-21ssh21:43:320
120022150,3sleep012012-21ssh23:23:030
3003099149,3cyclictest0-21swapper/320:05:153
3003099142,7cyclictest0-21swapper/319:14:593
30030991411,2cyclictest0-21swapper/323:28:353
30030991411,2cyclictest0-21swapper/323:19:553
30030991411,2cyclictest0-21swapper/322:39:253
30030991411,2cyclictest0-21swapper/300:20:063
30030991411,2cyclictest0-21swapper/300:04:063
3003099140,3cyclictest27335-21pzem_voltage22:30:523
3003099140,3cyclictest12723-21ssh00:31:363
3003099140,2cyclictest0-21swapper/323:43:353
3003099140,13cyclictest0-21swapper/322:50:253
3003099140,12cyclictest24123-21munin-node3
3003099140,12cyclictest0-21swapper/322:05:493
30029991411,2cyclictest0-21swapper/223:47:322
3002999140,2cyclictest0-21swapper/220:30:142
3002999140,12cyclictest6922-21apt-get22:10:122
3002999140,12cyclictest0-21swapper/222:28:402
3002999140,12cyclictest0-21swapper/221:34:232
3002899149,3cyclictest0-21swapper/121:16:031
3002899142,8cyclictest2353-21ssh21:31:011
3002899140,12cyclictest28352-21sh21:25:101
3002899140,12cyclictest13703-21diskmemload22:36:041
3002899140,12cyclictest0-21swapper/123:05:171
30027991411,2cyclictest0-21swapper/023:05:490
30027991411,2cyclictest0-21swapper/000:02:190
30027991410,2cyclictest0-21swapper/019:11:040
3002799140,3cyclictest17770-21ssh21:13:570
3002799140,1cyclictest0-21swapper/021:37:100
3002799140,12cyclictest0-21swapper/023:12:290
3002799140,12cyclictest0-21swapper/021:00:150
40712130,2sleep10-21swapper/123:49:141
30030991310,2cyclictest0-21swapper/323:53:363
30030991310,2cyclictest0-21swapper/321:31:583
30030991310,2cyclictest0-21swapper/320:10:163
30030991310,2cyclictest0-21swapper/319:50:133
30030991310,2cyclictest0-21swapper/300:35:183
3003099130,2cyclictest0-21swapper/322:12:293
3003099130,2cyclictest0-21swapper/321:24:483
3003099130,2cyclictest0-21swapper/319:30:173
3003099130,2cyclictest0-21swapper/300:10:403
3003099130,12cyclictest0-21swapper/321:50:133
3003099130,12cyclictest0-21swapper/321:48:253
3003099130,12cyclictest0-21swapper/321:06:063
3003099130,12cyclictest0-21swapper/319:45:173
3003099130,11cyclictest0-21swapper/323:07:203
3003099130,11cyclictest0-21swapper/323:01:333
3003099130,11cyclictest0-21swapper/322:21:093
30029991310,2cyclictest30026-21cyclictest22:05:132
30029991310,2cyclictest0-21swapper/223:50:532
30029991310,2cyclictest0-21swapper/223:40:182
30029991310,2cyclictest0-21swapper/223:38:292
30029991310,2cyclictest0-21swapper/223:16:432
30029991310,2cyclictest0-21swapper/222:16:312
30029991310,2cyclictest0-21swapper/221:55:172
30029991310,2cyclictest0-21swapper/220:51:032
30029991310,2cyclictest0-21swapper/200:26:072
30029991310,2cyclictest0-21swapper/200:17:222
3002999130,2cyclictest13703-21diskmemload22:46:042
3002999130,2cyclictest0-21swapper/221:45:112
3002999130,2cyclictest0-21swapper/219:20:122
3002999130,12cyclictest0-21swapper/222:58:222
3002999130,12cyclictest0-21swapper/222:44:312
3002999130,12cyclictest0-21swapper/221:35:222
3002999130,12cyclictest0-21swapper/221:12:122
3002999130,12cyclictest0-21swapper/220:55:182
3002899132,6cyclictest0-21swapper/120:55:001
3002899132,6cyclictest0-21swapper/119:55:001
3002899131,2cyclictest22511-21diskstats20:10:161
30028991310,2cyclictest27344-21kworker/u8:221:24:051
30028991310,2cyclictest0-21swapper/123:35:421
30028991310,2cyclictest0-21swapper/123:29:001
30028991310,2cyclictest0-21swapper/123:00:171
30028991310,2cyclictest0-21swapper/121:45:151
30028991310,2cyclictest0-21swapper/121:10:121
3002899130,2cyclictest17944-21sed20:00:001
3002899130,2cyclictest0-21swapper/121:43:311
3002899130,12cyclictest24620-21kworker/u8:022:50:041
3002899130,12cyclictest0-21swapper/123:41:001
3002899130,12cyclictest0-21swapper/100:08:011
3002799131,11cyclictest3643-21ssh22:06:020
30027991311,1cyclictest0-21swapper/020:50:290
30027991310,2cyclictest28440-21ssh22:31:580
30027991310,2cyclictest27220-21ssh21:56:430
30027991310,2cyclictest0-21swapper/023:15:150
30027991310,2cyclictest0-21swapper/022:45:090
30027991310,2cyclictest0-21swapper/022:25:090
30027991310,2cyclictest0-21swapper/020:25:170
30027991310,2cyclictest0-21swapper/000:15:470
3002799130,3cyclictest3649-21snmpd23:51:040
3002799130,2cyclictest25425-21ssh23:36:440
3002799130,2cyclictest0-21swapper/022:40:040
3002799130,2cyclictest0-21swapper/022:15:130
3002799130,2cyclictest0-21swapper/022:10:540
3002799130,2cyclictest0-21swapper/021:17:490
3002799130,2cyclictest0-21swapper/000:11:470
3002799130,1cyclictest0-21swapper/023:44:390
3002799130,1cyclictest0-21swapper/020:45:200
3002799130,12cyclictest6910-21ssh00:25:340
3002799130,12cyclictest13703-21diskmemload22:01:030
3002799130,12cyclictest0-21swapper/023:32:540
3002799130,12cyclictest0-21swapper/023:26:490
3002799130,12cyclictest0-21swapper/021:50:140
3002799130,12cyclictest0-21swapper/021:45:250
3002799130,12cyclictest0-21swapper/020:36:030
3002799130,12cyclictest0-21swapper/020:00:110
3002799130,12cyclictest0-21swapper/000:33:290
3002799130,12cyclictest0-21swapper/000:05:410
3002799130,11cyclictest0-21swapper/023:46:000
144702130,2sleep20-21swapper/200:00:102
81802120,2sleep10-21swapper/122:10:381
317102120,2sleep213703-21diskmemload21:28:132
3003099129,2cyclictest0-21swapper/321:39:383
3003099129,2cyclictest0-21swapper/321:10:563
3003099129,2cyclictest0-21swapper/320:40:163
3003099129,2cyclictest0-21swapper/300:07:463
3003099120,2cyclictest0-21swapper/322:55:073
3003099120,2cyclictest0-21swapper/319:25:183
3003099120,11cyclictest9330-21ssh23:20:153
3003099120,11cyclictest0-21swapper/322:45:063
3003099120,11cyclictest0-21swapper/319:40:183
3002999129,2cyclictest13703-21diskmemload23:26:012
3002999129,2cyclictest0-21swapper/223:23:092
3002999129,2cyclictest0-21swapper/223:05:022
3002999129,2cyclictest0-21swapper/222:37:522
3002999129,2cyclictest0-21swapper/221:40:212
3002999129,2cyclictest0-21swapper/200:32:322
3002999129,2cyclictest0-21swapper/200:20:332
3002999129,2cyclictest0-21swapper/200:06:012
3002999120,2cyclictest0-21swapper/223:10:182
3002999120,2cyclictest0-21swapper/222:21:082
3002999120,2cyclictest0-21swapper/221:17:212
3002999120,2cyclictest0-21swapper/219:55:172
3002999120,11cyclictest0-21swapper/222:51:012
3002999120,11cyclictest0-21swapper/222:04:432
3002999120,11cyclictest0-21swapper/221:20:172
3002899129,2cyclictest4877-21kworker/u8:323:50:011
3002899129,2cyclictest207150irq/24-eth120:25:101
3002899129,2cyclictest0-21swapper/122:15:151
3002899129,2cyclictest0-21swapper/121:56:221
3002899129,2cyclictest0-21swapper/119:15:191
3002899129,2cyclictest0-21swapper/100:30:411
3002899129,2cyclictest0-21swapper/100:23:001
3002899128,2cyclictest0-21swapper/100:25:161
3002899127,3cyclictest1822-21munin-node1
3002899122,5cyclictest0-21swapper/119:45:011
3002899121,9cyclictest14524-21apt-get00:00:131
3002899121,9cyclictest0-21swapper/122:45:141
3002899121,9cyclictest0-21swapper/121:00:091
3002899121,9cyclictest0-21swapper/119:35:191
3002899121,9cyclictest0-21swapper/100:15:121
3002899121,6cyclictest0-21swapper/120:45:001
3002899120,2cyclictest0-21swapper/123:58:111
3002899120,2cyclictest0-21swapper/123:23:211
3002899120,2cyclictest0-21swapper/122:20:521
3002899120,2cyclictest0-21swapper/120:05:131
3002899120,2cyclictest0-21swapper/100:12:401
3002899120,11cyclictest0-21swapper/123:10:211
3002899120,11cyclictest0-21swapper/122:56:411
3002899120,11cyclictest0-21swapper/122:40:431
3002899120,11cyclictest0-21swapper/122:05:211
3002899120,11cyclictest0-21swapper/121:38:011
3002899120,11cyclictest0-21swapper/120:45:201
3002899120,10cyclictest0-21swapper/120:00:271
3002799129,2cyclictest0-21swapper/022:36:390
3002799129,2cyclictest0-21swapper/000:35:090
3002799123,3cyclictest274-21jbd2/sda1-819:39:590
3002799120,2cyclictest0-21swapper/022:55:020
3002799120,2cyclictest0-21swapper/022:50:150
3002799120,1cyclictest0-21swapper/019:20:150
235812120,2sleep20-21swapper/223:00:482
98942110,1sleep20-21swapper/221:00:082
72412110,2sleep10-21swapper/123:18:031
3003099118,2cyclictest0-21swapper/321:26:053
3003099111,7cyclictest0-21swapper/320:33:583
3003099110,8cyclictest0-21swapper/319:16:013
3003099110,2cyclictest0-21swapper/323:57:513
3003099110,2cyclictest0-21swapper/322:04:413
3002999118,2cyclictest24802-21ssh00:10:222
3002999118,2cyclictest13703-21diskmemload23:30:042
3002999118,2cyclictest0-21swapper/220:05:132
3002999110,3cyclictest13396-21ssh23:58:482
3002999110,10cyclictest0-21swapper/219:35:152
3002899116,3cyclictest30738-21cut20:30:161
3002899111,8cyclictest7137-21mailstats19:31:011
3002899111,3cyclictest0-21swapper/120:35:151
3002899110,9cyclictest0-21swapper/121:05:181
3002799118,2cyclictest0-21swapper/020:10:420
3002799110,10cyclictest0-21swapper/019:15:470
130442110,2sleep00-21swapper/021:06:030
3003099107,2cyclictest0-21swapper/320:50:123
3003099107,2cyclictest0-21swapper/320:45:303
3003099107,2cyclictest0-21swapper/319:35:173
3003099107,2cyclictest0-21swapper/319:20:153
3003099102,7cyclictest0-21swapper/320:03:583
3003099101,7cyclictest17854-21cron19:59:593
3002999106,3cyclictest274-21jbd2/sda1-819:50:202
3002999100,9cyclictest18080-21kworker/u8:020:20:042
3002999100,9cyclictest0-21swapper/219:43:312
3002999100,8cyclictest3649-21snmpd20:36:132
3002899100,8cyclictest0-21swapper/120:15:151
3002899100,2cyclictest0-21swapper/119:10:131
3002799108,1cyclictest0-21swapper/020:30:170
3002799107,2cyclictest0-21swapper/020:05:190
3002799107,2cyclictest0-21swapper/019:50:170
3002799107,2cyclictest0-21swapper/019:25:120
3002799105,3cyclictest13497-21grep19:46:020
3002799100,2cyclictest0-21swapper/020:43:080
300309991,4cyclictest0-21swapper/321:00:083
300299996,2cyclictest0-21swapper/220:10:132
300289991,5cyclictest0-21swapper/119:49:591
300279994,3cyclictest8727-21needreboot20:55:200
300279994,3cyclictest6786-21load19:30:170
300279994,3cyclictest26254-21aten2.4_r3power20:20:130
300279994,3cyclictest24444-21df_abs20:15:140
300279994,3cyclictest17316-21timerandwakeup19:56:050
300279993,4cyclictest22150irq/25-ahci[00019:40:140
300309983,3cyclictest26146-21chrt20:20:013
300299985,2cyclictest26205-21kworker/u8:219:15:132
300299985,2cyclictest2105-21fschecks_count20:40:162
300299985,2cyclictest0-21swapper/219:26:012
300299983,3cyclictest3850-21head20:45:132
300299983,3cyclictest28356-21cpu20:25:122
300299983,3cyclictest24491-21df20:15:152
300299983,3cyclictest18993-21ntpq20:00:162
300299983,3cyclictest12477-21gltestperf21:05:172
300299973,2cyclictest6158-21aten2.4_r3power19:30:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional