You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 07:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu May 21, 2026 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15233992623,2cyclictest23536-21cut23:17:412
15233992623,2cyclictest23536-21cut23:17:412
15237992525,0cyclictest0-21swapper/322:52:213
1523399250,24cyclictest8424-21diskmemload22:54:132
1523399250,24cyclictest8424-21diskmemload21:29:562
1523199250,24cyclictest5792-21ssh22:04:111
1523199250,24cyclictest17435-21apt-get23:12:421
1523199250,24cyclictest0-21swapper/123:39:291
1522799250,24cyclictest2386-21ssh23:56:300
1522799250,0cyclictest0-21swapper/022:29:450
15237992423,1cyclictest0-21swapper/300:11:153
1523799241,1cyclictest151rcu_preempt00:30:063
1523799240,24cyclictest8424-21diskmemload22:04:113
1523799240,23cyclictest8424-21diskmemload00:07:213
1523799240,23cyclictest4765-21cron19:55:003
1523799240,23cyclictest0-21swapper/323:02:393
1523799240,23cyclictest0-21swapper/321:35:503
1523799240,23cyclictest0-21swapper/320:42:383
1523799240,1cyclictest0-21swapper/321:50:073
1523799240,0cyclictest8424-21diskmemload22:29:463
1523399240,23cyclictest8424-21diskmemload00:17:202
1523399240,23cyclictest0-21swapper/222:30:122
1523399240,23cyclictest0-21swapper/221:22:382
1523399240,0cyclictest0-21swapper/223:32:412
1523399240,0cyclictest0-21swapper/221:38:132
15231992424,0cyclictest8424-21diskmemload22:30:311
15231992423,1cyclictest26684-21sh22:51:571
15231992422,1cyclictest17585-21cron19:15:011
15231992421,2cyclictest31258-21dump-pmu-power20:50:001
15231992421,2cyclictest29299-21pmu-power21:27:521
1523199240,2cyclictest9621-21cron20:05:011
1523199240,24cyclictest0-21swapper/123:03:541
1523199240,24cyclictest0-21swapper/121:54:191
1523199240,24cyclictest0-21swapper/100:32:531
1523199240,23cyclictest8424-21diskmemload22:40:421
1523199240,23cyclictest0-21swapper/123:16:531
1523199240,23cyclictest0-21swapper/123:16:531
1523199240,0cyclictest8424-21diskmemload21:12:241
1522799240,24cyclictest0-21swapper/023:07:070
1522799240,23cyclictest5162-21ssh21:35:300
1522799240,23cyclictest0-21swapper/000:30:020
15237992323,0cyclictest8424-21diskmemload21:27:533
15237992323,0cyclictest8424-21diskmemload21:11:583
15237992323,0cyclictest0-21swapper/322:57:123
15237992323,0cyclictest0-21swapper/322:49:213
15237992323,0cyclictest0-21swapper/322:11:073
15237992323,0cyclictest0-21swapper/321:34:153
15237992323,0cyclictest0-21swapper/321:23:373
15237992323,0cyclictest0-21swapper/300:35:023
15237992322,0cyclictest0-21swapper/321:18:313
15237992321,1cyclictest0-21swapper/322:38:263
15237992321,1cyclictest0-21swapper/321:55:153
15237992321,1cyclictest0-21swapper/321:45:593
15237992320,2cyclictest30604-21ssh23:22:583
1523799230,2cyclictest11838-21sh00:04:193
1523799230,23cyclictest8424-21diskmemload23:18:053
1523799230,23cyclictest8424-21diskmemload23:18:053
1523799230,23cyclictest34-21ksoftirqd/323:38:453
1523799230,23cyclictest0-21swapper/322:16:533
1523799230,22cyclictest606-21dbus-daemon20:30:003
1523799230,22cyclictest5832-21ssh23:30:253
1523799230,22cyclictest11228-21ssh23:06:573
1523799230,1cyclictest3494-21sh00:26:063
1523799230,1cyclictest0-21swapper/323:55:243
1523799230,0cyclictest0-21swapper/323:50:583
1523799230,0cyclictest0-21swapper/322:22:173
1523799230,0cyclictest0-21swapper/300:17:033
15233992323,0cyclictest8424-21diskmemload22:23:482
15233992323,0cyclictest0-21swapper/223:40:282
15233992323,0cyclictest0-21swapper/222:42:342
15233992323,0cyclictest0-21swapper/221:43:262
15233992323,0cyclictest0-21swapper/221:43:262
15233992323,0cyclictest0-21swapper/200:20:342
15233992321,1cyclictest19703-21cron21:20:002
15233992321,1cyclictest0-21swapper/221:46:062
1523399230,2cyclictest11991-21ptp4l-jitter21:12:472
1523399230,23cyclictest0-21swapper/223:06:492
1523399230,23cyclictest0-21swapper/222:37:322
1523399230,23cyclictest0-21swapper/222:08:202
1523399230,23cyclictest0-21swapper/221:56:572
1523399230,23cyclictest0-21swapper/200:36:422
1523399230,22cyclictest0-21swapper/223:51:542
1523399230,22cyclictest0-21swapper/223:10:132
1523399230,22cyclictest0-21swapper/200:06:162
1523399230,1cyclictest8424-21diskmemload23:24:482
1523399230,0cyclictest0-21swapper/221:51:282
15231992323,0cyclictest8424-21diskmemload21:23:401
15231992323,0cyclictest0-21swapper/100:00:101
15231992322,1cyclictest0-21swapper/123:48:571
15231992321,1cyclictest0-21swapper/100:05:171
1523199230,2cyclictest31842-21diskmemload21:30:191
1523199230,23cyclictest0-21swapper/123:54:001
1523199230,23cyclictest0-21swapper/121:35:181
1523199230,23cyclictest0-21swapper/100:27:521
1523199230,22cyclictest3963-21ssh23:28:131
1523199230,22cyclictest13205-21sh22:11:151
1523199230,0cyclictest8424-21diskmemload00:15:181
1523199230,0cyclictest0-21swapper/123:44:031
1523199230,0cyclictest0-21swapper/123:21:431
15227992323,0cyclictest0-21swapper/023:24:470
15227992323,0cyclictest0-21swapper/022:43:100
15227992323,0cyclictest0-21swapper/022:10:080
15227992323,0cyclictest0-21swapper/022:09:190
15227992323,0cyclictest0-21swapper/022:04:230
15227992323,0cyclictest0-21swapper/021:59:110
15227992323,0cyclictest0-21swapper/021:30:010
15227992323,0cyclictest0-21swapper/021:10:040
15227992323,0cyclictest0-21swapper/000:12:470
15227992323,0cyclictest0-21swapper/000:09:200
1522799230,23cyclictest0-21swapper/023:43:080
1522799230,23cyclictest0-21swapper/023:36:090
1522799230,23cyclictest0-21swapper/023:33:580
1522799230,23cyclictest0-21swapper/023:19:170
1522799230,23cyclictest0-21swapper/023:19:170
1522799230,23cyclictest0-21swapper/023:12:190
1522799230,23cyclictest0-21swapper/021:25:530
1522799230,23cyclictest0-21swapper/000:37:360
1522799230,23cyclictest0-21swapper/000:21:400
1522799230,1cyclictest9358-21ssh23:04:440
1522799230,0cyclictest0-21swapper/023:47:140
1522799230,0cyclictest0-21swapper/021:40:120
1522799230,0cyclictest0-21swapper/021:40:120
15237992222,0cyclictest0-21swapper/323:46:353
15237992222,0cyclictest0-21swapper/321:40:373
15237992222,0cyclictest0-21swapper/321:40:373
15237992220,1cyclictest32586-21ssh00:22:453
15237992220,1cyclictest14424-21latency_hist20:15:013
15237992220,1cyclictest0-21swapper/323:25:423
15237992220,1cyclictest0-21swapper/323:12:053
1523799220,22cyclictest331rcuc/322:42:443
1523799220,21cyclictest0-21swapper/323:40:443
1523799220,21cyclictest0-21swapper/322:32:293
1523799220,21cyclictest0-21swapper/320:17:403
15233992222,0cyclictest0-21swapper/200:00:592
15233992221,1cyclictest19712-21apt-get20:27:392
15233992221,1cyclictest0-21swapper/223:56:152
15233992221,1cyclictest0-21swapper/222:47:032
15233992220,2cyclictest9128-21ssh00:30:252
1523399220,21cyclictest8424-21diskmemload22:15:372
1523399220,21cyclictest8424-21diskmemload22:00:402
1523399220,21cyclictest22841-21ssh23:45:352
1523399220,21cyclictest2203-21apt-get22:30:012
1523399220,21cyclictest0-21swapper/223:36:522
1523399220,21cyclictest0-21swapper/222:55:362
1523399220,21cyclictest0-21swapper/222:10:562
1523399220,21cyclictest0-21swapper/221:31:522
1523399220,21cyclictest0-21swapper/200:10:202
1523399220,1cyclictest0-21swapper/200:26:022
1523399220,0cyclictest8424-21diskmemload23:25:042
15231992222,0cyclictest8424-21diskmemload22:15:151
15231992222,0cyclictest0-21swapper/121:45:441
15231992222,0cyclictest0-21swapper/100:10:511
15231992221,1cyclictest25655-21apt-get19:32:391
15231992220,1cyclictest24060-21runrttasks22:20:341
15231992220,1cyclictest10882-21df22:37:401
15231992219,2cyclictest7676-21ssh22:06:231
15231992219,2cyclictest3655-21latency_hist21:00:011
15231992219,2cyclictest3655-21latency_hist21:00:011
1523199220,22cyclictest31304-21ssh22:55:371
1523199220,21cyclictest8424-21diskmemload21:55:421
1523199220,21cyclictest1605-21sh00:23:541
1523199220,21cyclictest0-21swapper/123:05:071
1523199220,1cyclictest6434-21ssh23:31:191
1523199220,1cyclictest29454-21rm22:25:161
1523199220,1cyclictest21273-21rm22:47:111
1523199220,1cyclictest10893-21ssh21:40:351
1523199220,1cyclictest10893-21ssh21:40:351
1523199220,1cyclictest0-21swapper/121:18:151
1523199220,0cyclictest0-21swapper/100:35:441
15227992222,0cyclictest0-21swapper/021:50:120
15227992222,0cyclictest0-21swapper/000:26:160
15227992222,0cyclictest0-21swapper/000:15:270
15227992221,1cyclictest62550irq/127-eno122:21:420
15227992221,1cyclictest3957-21ssh22:31:380
15227992220,2cyclictest0-21swapper/022:59:190
1522799220,22cyclictest8424-21diskmemload21:20:160
1522799220,22cyclictest0-21swapper/022:37:250
1522799220,21cyclictest26921-21apt-get20:42:380
1522799220,21cyclictest24017-21cron20:35:000
1522799220,21cyclictest18331-21ssh22:15:350
1522799220,21cyclictest14963-21ssh21:15:490
1522799220,1cyclictest8424-21diskmemload22:45:430
1522799220,1cyclictest834-21ssh23:26:190
1522799220,1cyclictest7303-21sh00:00:300
1522799220,1cyclictest30002-21apt-get23:52:400
1522799220,0cyclictest0-21swapper/021:48:020
15237992121,0cyclictest331rcuc/320:50:003
15237992120,1cyclictest34-21ksoftirqd/322:05:413
15237992120,0cyclictest0-21swapper/319:17:393
1523799210,20cyclictest606-21dbus-daemon19:25:013
15233992119,2cyclictest32415-21perf19:45:002
15233992119,1cyclictest19257-21awk20:25:012
15231992119,1cyclictest17315-21apt-get20:22:381
1523199210,20cyclictest31714-21apt-get20:52:391
1523199210,1cyclictest2387-21latency_hist19:50:001
1523199210,0cyclictest24504-21apt-get20:37:381
1522799210,21cyclictest0-21swapper/022:50:060
1522799210,0cyclictest0-21swapper/019:15:010
15237992020,0cyclictest0-21swapper/320:57:403
15237992020,0cyclictest0-21swapper/320:57:403
15237992020,0cyclictest0-21swapper/319:37:403
15237992020,0cyclictest0-21swapper/319:12:383
1523799200,0cyclictest0-21swapper/320:32:393
15233992020,0cyclictest0-21swapper/221:02:392
15233992020,0cyclictest0-21swapper/220:37:392
15233992020,0cyclictest0-21swapper/220:12:392
15233992020,0cyclictest0-21swapper/219:52:392
15233992020,0cyclictest0-21swapper/219:32:392
15231992019,1cyclictest23253-21apt-get19:27:371
15231992019,0cyclictest0-21swapper/119:22:381
1523199200,0cyclictest0-21swapper/119:42:381
15227992020,0cyclictest0-21swapper/020:12:380
15227992020,0cyclictest0-21swapper/019:27:370
1522799200,0cyclictest0-21swapper/019:22:380
15237991919,0cyclictest0-21swapper/320:55:013
15237991919,0cyclictest0-21swapper/320:07:393
15237991917,1cyclictest0-21swapper/320:05:013
15233991919,0cyclictest15653-21apt-get19:12:382
15233991919,0cyclictest0-21swapper/221:07:412
15233991919,0cyclictest0-21swapper/220:57:402
15233991919,0cyclictest0-21swapper/220:57:402
15233991919,0cyclictest0-21swapper/219:20:022
15233991918,1cyclictest25204-21munin-plugin-st19:30:012
15231991918,0cyclictest10104-21apt-get20:07:391
1522799190,1cyclictest31268-21munin-run20:50:000
15237991818,0cyclictest0-21swapper/319:42:383
15237991818,0cyclictest0-21swapper/319:32:393
15237991817,1cyclictest0-21swapper/319:47:373
15237991816,1cyclictest8427-21ssh21:10:013
15233991818,0cyclictest0-21swapper/220:52:392
15233991818,0cyclictest0-21swapper/220:07:392
15233991817,1cyclictest0-21swapper/220:17:402
15231991818,0cyclictest0-21swapper/120:12:391
15231991814,3cyclictest29968-21sh19:40:001
15227991818,0cyclictest0-21swapper/020:37:390
15227991817,1cyclictest4113-21apt-get21:02:390
15227991817,1cyclictest27569-21idleruntime-cro19:35:010
15227991817,1cyclictest20020-21sendmail-msp19:20:010
15227991816,1cyclictest0-21swapper/020:25:010
15237991717,0cyclictest0-21swapper/321:00:173
1523799170,0cyclictest0-21swapper/319:57:403
15233991717,0cyclictest0-21swapper/219:47:372
15231991717,0cyclictest0-21swapper/120:42:381
15231991717,0cyclictest0-21swapper/120:17:401
15231991717,0cyclictest0-21swapper/119:57:401
15231991717,0cyclictest0-21swapper/119:17:401
15227991717,0cyclictest0-21swapper/021:07:410
15227991717,0cyclictest0-21swapper/020:27:390
15227991715,1cyclictest32416-21munin-run19:45:000
15237991616,0cyclictest0-21swapper/320:37:393
15233991614,1cyclictest774-21runrttasks19:18:412
15233991614,1cyclictest26921-21apt-get20:42:382
1523399160,14cyclictest0-21swapper/219:37:362
15231991616,0cyclictest0-21swapper/120:27:391
15231991615,1cyclictest22110-21apt-get20:32:391
15227991616,0cyclictest0-21swapper/019:57:400
15227991616,0cyclictest0-21swapper/019:52:390
15227991611,5cyclictest0-21swapper/019:37:360
15227991515,0cyclictest1694-21apt-get20:57:400
15227991515,0cyclictest1694-21apt-get20:57:400
1523799140,14cyclictest0-21swapper/320:20:293
1523799140,14cyclictest0-21swapper/319:25:023
15233991414,0cyclictest0-21swapper/220:47:082
15233991414,0cyclictest0-21swapper/220:30:172
15233991414,0cyclictest0-21swapper/219:55:212
1523399140,0cyclictest0-21swapper/220:00:012
1523199140,0cyclictest0-21swapper/121:00:251
15227991414,0cyclictest0-21swapper/019:45:090
1522799140,14cyclictest0-21swapper/020:50:320
1522799140,14cyclictest0-21swapper/020:15:050
1522799140,0cyclictest0-21swapper/020:05:160
1522799140,0cyclictest0-21swapper/020:00:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional