You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-06 - 12:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Mon Apr 06, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2106221490,12sleep32842499cyclictest18:13:233
28423991065,27cyclictest0-21swapper/222:48:232
28423991064,53cyclictest0-21swapper/220:21:082
28418991053,48cyclictest0-21swapper/022:48:070
28423991035,28cyclictest0-21swapper/219:08:292
28423991014,48cyclictest0-21swapper/219:58:332
28423991014,28cyclictest0-21swapper/220:25:092
28418991014,10cyclictest21718-21df_abs20:58:110
28423991004,51cyclictest0-21swapper/220:38:162
28423991004,48cyclictest1419-21runrttasks22:30:462
28423991004,47cyclictest0-21swapper/220:08:122
2842399994,50cyclictest0-21swapper/219:33:252
2842399984,50cyclictest0-21swapper/221:38:162
2841899986,15cyclictest0-21swapper/021:08:280
2841899984,31cyclictest0-21swapper/022:02:170
2841899984,31cyclictest0-21swapper/021:24:340
2841899984,31cyclictest0-21swapper/021:24:340
2842399974,49cyclictest0-21swapper/220:53:092
2842399974,46cyclictest0-21swapper/219:53:162
2841899974,50cyclictest0-21swapper/021:38:300
2841899965,16cyclictest0-21swapper/022:26:230
2841899964,51cyclictest0-21swapper/022:33:070
2841899964,30cyclictest0-21swapper/020:23:120
2842399955,52cyclictest0-21swapper/222:34:042
2841899955,15cyclictest0-21swapper/020:02:270
2842399944,50cyclictest0-21swapper/220:03:312
2842399944,50cyclictest0-21swapper/220:03:312
2842399944,29cyclictest0-21swapper/219:28:322
2842399934,50cyclictest0-21swapper/219:38:402
28418999210,25cyclictest31342-21munin-node21:13:160
28418999124,13cyclictest0-21swapper/019:23:190
28418999124,13cyclictest0-21swapper/019:23:190
28424999029,53cyclictest1419-21runrttasks17:43:053
2841899905,45cyclictest0-21swapper/017:29:360
2841899905,36cyclictest0-21swapper/022:11:110
2841899904,31cyclictest0-21swapper/021:07:270
28424998929,53cyclictest0-21swapper/320:03:223
28424998929,53cyclictest0-21swapper/320:03:223
2842499883,31cyclictest0-21swapper/321:18:323
28424998811,12cyclictest0-21swapper/320:43:123
28424998811,12cyclictest0-21swapper/320:43:123
2842399885,27cyclictest0-21swapper/221:00:002
28424998728,52cyclictest17047-21grep19:13:183
28424998725,53cyclictest0-21swapper/322:08:223
28424998628,50cyclictest32619-21rm22:48:303
28424998624,54cyclictest0-21swapper/321:53:293
2842399864,51cyclictest0-21swapper/221:54:462
2841899865,15cyclictest0-21swapper/020:16:290
28424998521,9cyclictest19088-21missed_timers20:53:233
28424998520,8cyclictest21175-21diskmemload22:07:303
28424998520,8cyclictest21175-21diskmemload22:07:303
28424998434,43cyclictest3611-21df_inode19:43:173
28424998423,12cyclictest0-21swapper/317:58:183
28424998423,12cyclictest0-21swapper/317:58:183
2842499834,72cyclictest0-21swapper/321:07:213
2842499833,8cyclictest14582-21cpuspeed_turbos19:08:153
2842499833,72cyclictest0-21swapper/319:39:073
28424998328,48cyclictest20757-21gltestperf20:08:173
28424998312,11cyclictest0-21swapper/320:00:093
129152830,3sleep229-21ksoftirqd/222:20:122
2842499824,11cyclictest0-21swapper/319:28:173
28424998232,44cyclictest6788-21cpuspeed_turbos19:48:153
28424998230,45cyclictest30129-21cut21:58:153
2842499823,12cyclictest17611-21crond20:52:583
2842499823,11cyclictest0-21swapper/321:17:573
28424998225,50cyclictest0-21swapper/321:23:133
28424998225,50cyclictest0-21swapper/321:23:133
28424998222,10cyclictest24977-21hwlatdetect22:38:153
28424998222,10cyclictest11411-21gltestperf22:18:133
28424998220,9cyclictest18998-21missed_timers18:08:283
28424998135,39cyclictest27380-21chrt22:43:023
2842499813,26cyclictest14593-21ssh22:23:153
28424998126,9cyclictest31389-21tr17:28:203
28424998124,10cyclictest6279-21unixbench_singl20:33:323
28424998122,8cyclictest29068-21fschecks_count19:33:193
28422998130,28cyclictest1919-21crond18:43:031
2842499804,30cyclictest0-21swapper/321:28:193
2842499803,70cyclictest0-21swapper/321:08:113
2842499803,31cyclictest0-21swapper/322:28:153
2842499803,29cyclictest0-21swapper/320:23:173
28424998028,46cyclictest0-21swapper/319:26:433
28424998028,46cyclictest0-21swapper/319:26:433
28424998020,9cyclictest20098-21grep21:43:153
2842499793,29cyclictest0-21swapper/320:15:063
2842499793,28cyclictest10783-21rm20:42:343
28424997922,13cyclictest0-21swapper/321:33:213
28424997921,10cyclictest24205-21sed21:48:273
28422997929,28cyclictest21228-21df_abs22:33:091
28422997929,25cyclictest21511-21cpuspeed20:58:091
28418997918,10cyclictest31986-21aten_r1power_po19:38:140
2842499783,32cyclictest0-21swapper/320:58:203
2842499783,28cyclictest0-21swapper/320:29:203
2842499783,10cyclictest0-21swapper/319:53:273
28424997821,10cyclictest26741-21aten_r1power_po20:18:123
28424997820,9cyclictest25014-21munin-node18:23:313
28424997820,9cyclictest12631-21gltestperf19:03:223
28424997815,12cyclictest0-21swapper/318:33:143
28422997815,49cyclictest11858-21kworker/1:219:33:521
2842499773,31cyclictest0-21swapper/321:37:593
2842499773,25cyclictest0-21swapper/318:38:213
2842499763,31cyclictest0-21swapper/322:37:543
2842499763,28cyclictest1287-21snmpd22:15:153
28424997625,11cyclictest0-21swapper/318:53:043
28422997632,26cyclictest6764-21cpuspeed_turbos19:48:151
28422997628,28cyclictest27513-21ssh21:53:271
28422997624,44cyclictest0-21swapper/120:33:271
2842499753,9cyclictest2043-21cut17:33:283
28424997523,8cyclictest1419-21runrttasks18:20:323
28422997527,31cyclictest0-21swapper/122:03:231
28422997527,31cyclictest0-21swapper/122:03:231
28422997525,43cyclictest0-21swapper/120:43:141
28422997525,43cyclictest0-21swapper/120:43:141
28424997423,10cyclictest29457-21gltestperf17:23:253
28424997423,10cyclictest1419-21runrttasks17:48:333
28424997422,9cyclictest1419-21runrttasks17:53:363
28422997433,24cyclictest14744-21perl22:23:161
28422997426,31cyclictest25173-21tail18:23:171
28422997425,32cyclictest29045-21iostat_ios21:08:191
28422997424,42cyclictest20491-21cut20:08:151
2842499734,25cyclictest1419-21runrttasks18:56:193
28424997325,8cyclictest7020-21memory17:43:293
28422997330,25cyclictest6169-21sh19:48:001
28422997328,27cyclictest1287-21snmpd20:17:241
28422997328,26cyclictest30721-21fschecks_time20:23:171
28422997326,25cyclictest121850irq/46-eth021:23:201
28422997326,25cyclictest121850irq/46-eth021:23:201
28422997325,40cyclictest0-21swapper/119:56:411
28422997324,43cyclictest26303-21wc19:28:321
28422997324,42cyclictest0-21swapper/122:38:231
28422997323,29cyclictest0-21swapper/122:49:071
28422997313,39cyclictest0-21swapper/121:37:461
202352730,3sleep012-21rcu_preempt21:43:170
28424997224,8cyclictest10709-21ntp_offset18:58:283
28424997222,12cyclictest0-21swapper/318:33:043
28422997223,27cyclictest0-21swapper/122:18:241
28422997222,43cyclictest0-21swapper/122:08:451
28422997222,28cyclictest0-21swapper/119:58:221
28422997221,32cyclictest0-21swapper/122:00:061
28422997219,47cyclictest0-21swapper/121:16:591
28422997219,45cyclictest0-21swapper/120:03:301
28422997219,45cyclictest0-21swapper/120:03:301
62062710,3sleep2281ktimersoftd/221:23:112
62062710,3sleep2281ktimersoftd/221:23:112
2842499716,29cyclictest19165-21tail19:18:143
28422997128,34cyclictest16181-21ssh21:38:101
28422997127,25cyclictest19575-21timerwakeupswit20:53:311
28422997124,40cyclictest0-21swapper/117:28:301
28422997124,28cyclictest10670-21munin-node17:53:261
28422997123,40cyclictest9775-21cpuspeed_turbos18:58:151
28422997123,39cyclictest0-21swapper/120:38:151
28422997122,32cyclictest16379-21munin-run19:13:021
28422997120,44cyclictest0-21swapper/118:07:231
2842499703,29cyclictest15509-21head18:03:163
28422997029,32cyclictest24390-21unixbench_multi21:48:291
28422997029,26cyclictest9016-21unixbench_singl22:13:281
28422997026,37cyclictest3669-21ssh20:31:071
28422997026,28cyclictest2974-21df_abs21:18:121
28422997024,38cyclictest0-21swapper/120:18:131
28422997023,32cyclictest0-21swapper/120:52:201
28422997021,42cyclictest0-21swapper/119:24:191
28422997021,42cyclictest0-21swapper/119:24:191
28422996925,27cyclictest658-21needreboot19:38:271
28422996923,29cyclictest0-21swapper/117:43:271
28422996922,40cyclictest0-21swapper/122:43:131
28422996922,30cyclictest0-21swapper/118:58:041
28422996826,27cyclictest9296-21iostat17:48:271
28422996826,23cyclictest25055-21df21:03:121
28422996824,35cyclictest1287-21snmpd17:24:351
28422996824,27cyclictest0-21swapper/121:43:001
28422996822,30cyclictest0-21swapper/121:28:141
28422996821,39cyclictest0-21swapper/122:28:061
2842499672,32cyclictest2234-21munin-node18:43:163
2842499672,32cyclictest2234-21munin-node18:43:163
2842399674,57cyclictest0-21swapper/222:07:182
2842399674,57cyclictest0-21swapper/222:07:182
28422996722,28cyclictest0-21swapper/117:38:181
28422996717,32cyclictest0-21swapper/118:18:041
2841899675,54cyclictest0-21swapper/020:53:580
28422996625,34cyclictest1750-21fschecks_time17:33:241
28422996619,33cyclictest0-21swapper/119:17:571
248599660,6rtkit-daemon2484-21rtkit-daemon21:15:322
248599660,4rtkit-daemon2484-21rtkit-daemon21:51:082
28422996523,34cyclictest19581-21df_inode19:18:171
28422996522,26cyclictest1247-21lldpd18:11:311
2842399645,52cyclictest0-21swapper/222:23:162
248599640,7rtkit-daemon15412-21ssh21:37:092
28422996320,24cyclictest0-21swapper/118:43:291
28422996320,24cyclictest0-21swapper/118:43:291
2842399625,51cyclictest0-21swapper/220:13:142
2842399625,40cyclictest0-21swapper/218:53:032
2842399624,51cyclictest0-21swapper/222:13:092
28422996227,22cyclictest5839-21missed_timers18:48:301
28422996225,31cyclictest0-21swapper/118:23:041
28422996219,27cyclictest0-21swapper/119:03:131
2841899624,13cyclictest0-21swapper/020:38:450
2842399615,50cyclictest0-21swapper/221:58:212
2842399614,51cyclictest0-21swapper/221:03:102
2842399614,51cyclictest0-21swapper/220:52:592
2842399614,51cyclictest0-21swapper/219:48:332
2842399614,51cyclictest0-21swapper/219:43:262
2842399614,50cyclictest0-21swapper/221:28:082
2842399613,52cyclictest0-21swapper/222:08:282
2842399613,51cyclictest4868-21runrttasks21:20:312
2842399612,53cyclictest0-21swapper/222:43:072
28422996126,27cyclictest29560-21sadc18:33:031
2841899614,50cyclictest0-21swapper/019:54:100
2841899614,11cyclictest24041-21munin-node22:38:290
2842399604,50cyclictest0-21swapper/220:28:322
28422996023,27cyclictest14461-21taskset17:58:341
28422996023,27cyclictest14461-21taskset17:58:341
2841899604,48cyclictest0-21swapper/021:33:070
2841899603,50cyclictest3355-21yum-updatesd-he22:07:310
2841899603,50cyclictest3355-21yum-updatesd-he22:07:310
2841899603,49cyclictest4387-21taskset19:43:290
28422995921,32cyclictest0-21swapper/118:33:171
2841899595,14cyclictest0-21swapper/020:29:520
2841899594,48cyclictest0-21swapper/021:28:240
2842399584,48cyclictest0-21swapper/219:18:192
2841899584,48cyclictest0-21swapper/021:48:070
2841899584,36cyclictest0-21swapper/020:04:220
2841899584,36cyclictest0-21swapper/020:04:220
2842399574,48cyclictest0-21swapper/220:47:592
2842399574,48cyclictest0-21swapper/220:47:592
2842399574,47cyclictest29134-21latency21:08:212
2842399574,27cyclictest0-21swapper/222:38:152
2842399573,48cyclictest0-21swapper/217:43:372
28422995735,16cyclictest28390-21crond17:23:071
2841899574,13cyclictest0-21swapper/019:31:210
2842399564,46cyclictest0-21swapper/221:43:152
2842399562,48cyclictest0-21swapper/219:03:152
2841899564,38cyclictest0-21swapper/019:36:000
2841899564,36cyclictest0-21swapper/020:21:510
2841899564,32cyclictest0-21swapper/022:32:070
2841899564,12cyclictest0-21swapper/020:45:210
2841899564,12cyclictest0-21swapper/020:45:210
2841899563,48cyclictest0-21swapper/022:22:390
2841899563,47cyclictest0-21swapper/019:52:530
2842399553,47cyclictest0-21swapper/217:53:282
2841899559,27cyclictest0-21swapper/022:43:060
28418995522,13cyclictest0-21swapper/020:08:190
28418995519,23cyclictest2531-21head21:18:090
28418995517,19cyclictest15051-21df_abs20:48:140
2842399543,10cyclictest0-21swapper/219:27:152
2842399543,10cyclictest0-21swapper/219:27:152
2842399542,46cyclictest0-21swapper/217:58:202
2842399542,46cyclictest0-21swapper/217:58:202
2841899548,28cyclictest0-21swapper/022:13:140
2841899545,29cyclictest0-21swapper/021:53:180
2841899545,13cyclictest0-21swapper/018:19:450
2841899544,44cyclictest0-21swapper/018:48:350
2841899544,31cyclictest0-21swapper/018:58:030
2841899544,30cyclictest0-21swapper/020:33:310
2841899543,45cyclictest0-21swapper/018:43:370
2841899543,45cyclictest0-21swapper/018:43:370
28418995421,14cyclictest0-21swapper/018:38:050
2842399533,44cyclictest0-21swapper/217:38:332
2842399532,46cyclictest0-21swapper/220:33:202
2841899534,31cyclictest0-21swapper/018:09:430
2841899534,30cyclictest0-21swapper/018:38:150
2841899534,27cyclictest0-21swapper/019:13:140
2841899533,31cyclictest7250irq/45-ahci17:28:080
28418995320,14cyclictest0-21swapper/017:38:280
28418995319,15cyclictest0-21swapper/018:33:050
28418995315,22cyclictest0-21swapper/017:53:160
2842399524,30cyclictest0-21swapper/218:03:262
2842399523,43cyclictest0-21swapper/218:33:042
2841899524,30cyclictest0-21swapper/019:18:150
2841899524,29cyclictest0-21swapper/019:03:190
28418995221,13cyclictest0-21swapper/017:48:060
2842399514,30cyclictest0-21swapper/218:57:302
2842399514,30cyclictest0-21swapper/218:09:432
2842399514,29cyclictest0-21swapper/218:58:332
2842399514,28cyclictest0-21swapper/217:49:392
2842399514,27cyclictest0-21swapper/217:33:082
2842399513,40cyclictest1017-21aten2.4-expect17:33:172
2841899514,29cyclictest0-21swapper/018:13:310
2841899514,29cyclictest0-21swapper/018:07:250
2841899514,29cyclictest0-21swapper/017:48:270
2841899513,43cyclictest0-21swapper/018:24:460
28418995121,13cyclictest0-21swapper/017:58:280
28418995121,13cyclictest0-21swapper/017:58:280
2842399504,27cyclictest0-21swapper/218:23:152
2842399503,40cyclictest30047-21gzip17:23:352
2842399503,27cyclictest0-21swapper/218:18:292
2842399503,25cyclictest0-21swapper/219:13:152
2842399502,41cyclictest0-21swapper/218:38:152
2841899505,28cyclictest0-21swapper/018:59:510
2842399494,26cyclictest0-21swapper/218:44:482
2842399494,26cyclictest0-21swapper/218:44:482
2841899494,28cyclictest0-21swapper/017:34:360
28423994816,12cyclictest0-21swapper/218:13:272
2842399473,23cyclictest0-21swapper/218:33:292
28418994714,15cyclictest0-21swapper/019:08:130
283332444,33sleep00-21swapper/017:22:270
2842399363,27cyclictest0-21swapper/217:23:072
2842499353,27cyclictest28503-21cat17:23:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional