You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-04 - 04:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Thu Jun 04, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12054992523,1cyclictest2349-21apt-get22:58:493
1205499250,24cyclictest16634-21diskmemload22:48:523
1205499250,24cyclictest16634-21diskmemload00:34:563
12053992523,1cyclictest0-21swapper/221:55:252
12053992523,1cyclictest0-21swapper/219:15:012
1205399250,0cyclictest0-21swapper/223:24:572
12052992523,1cyclictest0-21swapper/123:40:311
1205299250,2cyclictest2330-21apt-get23:28:481
1205299250,24cyclictest32676-21kworker/u8:223:58:181
1205299250,24cyclictest0-21swapper/123:00:321
1205299250,24cyclictest0-21swapper/100:20:081
1205299250,0cyclictest0-21swapper/121:27:501
12047992523,1cyclictest12676-21munin-run19:15:010
1204799250,24cyclictest7702-21apt-get23:03:470
1204799250,1cyclictest17497-21ssh22:13:010
12054992422,1cyclictest0-21swapper/322:05:363
12054992422,1cyclictest0-21swapper/322:05:363
1205499240,23cyclictest16634-21diskmemload23:41:383
1205499240,1cyclictest17419-21ssh00:12:383
1205399240,24cyclictest0-21swapper/223:50:242
1205399240,23cyclictest16634-21diskmemload00:17:552
1205399240,23cyclictest0-21swapper/223:03:472
1205399240,23cyclictest0-21swapper/222:42:062
1205399240,23cyclictest0-21swapper/222:26:352
1205399240,23cyclictest0-21swapper/222:08:352
1205399240,23cyclictest0-21swapper/222:08:352
1205399240,23cyclictest0-21swapper/200:10:182
1205399240,1cyclictest15021-1kworker/u9:023:46:132
12052992422,1cyclictest22616-21sh22:46:361
1205299241,22cyclictest0-21swapper/123:14:221
1205299240,24cyclictest0-21swapper/100:26:141
1205299240,23cyclictest16634-21diskmemload23:49:211
1205299240,23cyclictest0-21swapper/122:27:271
1205299240,23cyclictest0-21swapper/122:17:491
1205299240,23cyclictest0-21swapper/100:00:061
1205299240,1cyclictest16634-21diskmemload22:14:501
1205299240,0cyclictest0-21swapper/122:21:511
12047992423,1cyclictest62550irq/127-eno100:25:520
12047992423,1cyclictest11290-21ssh23:06:150
12047992423,1cyclictest0-21swapper/021:55:250
12047992421,2cyclictest28404-21ssh22:52:140
1204799240,24cyclictest28104-21ssh23:21:530
1204799240,24cyclictest16634-21diskmemload00:10:180
1204799240,24cyclictest0-21swapper/023:50:240
1204799240,24cyclictest0-21swapper/022:04:250
1204799240,23cyclictest5703-21ssh00:31:300
1204799240,1cyclictest62550irq/127-eno123:46:130
1204799240,1cyclictest13632-21basename21:00:000
1204799240,0cyclictest0-21swapper/021:42:260
12054992323,0cyclictest16634-21diskmemload23:56:183
12054992323,0cyclictest0-21swapper/322:28:503
12054992323,0cyclictest0-21swapper/322:10:043
12054992323,0cyclictest0-21swapper/321:33:333
12054992323,0cyclictest0-21swapper/300:00:473
12054992321,1cyclictest18664-21rm21:12:453
12054992320,2cyclictest22766-21ssh21:47:543
12054992320,2cyclictest21033-21ssh22:15:173
1205499230,2cyclictest10557-21ssh00:35:503
1205499230,23cyclictest16634-21diskmemload23:36:503
1205499230,23cyclictest16634-21diskmemload23:06:043
1205499230,23cyclictest16634-21diskmemload22:22:283
1205499230,22cyclictest27648-21ssh22:51:113
1205499230,22cyclictest20606-21ssh23:14:343
1205499230,1cyclictest16634-21diskmemload00:26:083
1205499230,0cyclictest16634-21diskmemload22:44:003
1205499230,0cyclictest16634-21diskmemload21:39:193
1205499230,0cyclictest0-21swapper/323:15:043
1205499230,0cyclictest0-21swapper/321:27:193
12053992323,0cyclictest0-21swapper/222:13:362
12053992323,0cyclictest0-21swapper/221:45:452
12053992323,0cyclictest0-21swapper/200:25:522
12053992321,1cyclictest0-21swapper/223:58:332
12053992321,1cyclictest0-21swapper/222:52:142
12053992321,1cyclictest0-21swapper/222:31:342
12053992320,2cyclictest15727-21apt19:25:002
12053992319,0cyclictest151rcu_preempt22:21:182
1205399230,23cyclictest0-21swapper/223:42:412
1205399230,23cyclictest0-21swapper/222:04:252
1205399230,23cyclictest0-21swapper/200:05:492
1205399230,22cyclictest9797-21cron00:35:012
1205399230,22cyclictest6086-21sh23:31:262
1205399230,22cyclictest30059-21ssh00:23:552
1205399230,22cyclictest0-21swapper/200:37:152
1205399230,1cyclictest18043-21ssh21:11:452
1205399230,1cyclictest13624-21munin-run21:00:002
1205399230,0cyclictest0-21swapper/223:15:232
1205399230,0cyclictest0-21swapper/221:51:032
1205399230,0cyclictest0-21swapper/221:42:262
12052992323,0cyclictest0-21swapper/122:04:181
12052992322,1cyclictest0-21swapper/121:58:401
12052992321,1cyclictest22003-21sh23:16:191
12052992321,1cyclictest0-21swapper/123:20:011
12052992321,1cyclictest0-21swapper/121:47:081
12052992321,1cyclictest0-21swapper/119:20:001
12052992320,2cyclictest5244-21ssh23:30:091
12052992320,2cyclictest12139-21sh23:07:331
1205299230,2cyclictest10540-21latency_hist22:35:001
1205299230,22cyclictest5203-21sh21:31:041
1205299230,22cyclictest27353-21ssh22:50:391
1205299230,22cyclictest20724-21ssh21:15:241
1205299230,22cyclictest11680-21sh22:07:531
1205299230,22cyclictest11680-21sh22:07:531
1205299230,1cyclictest10780-21sh00:36:101
1205299230,0cyclictest16634-21diskmemload21:44:571
1205299230,0cyclictest0-21swapper/123:36:261
1205299230,0cyclictest0-21swapper/122:36:481
1205299230,0cyclictest0-21swapper/121:21:431
12047992323,0cyclictest0-21swapper/021:45:450
12047992323,0cyclictest0-21swapper/021:33:500
12047992322,1cyclictest62550irq/127-eno123:27:470
12047992322,1cyclictest62550irq/127-eno122:31:270
12047992322,1cyclictest62550irq/127-eno121:24:240
12047992322,1cyclictest0-21swapper/022:55:170
12047992321,2cyclictest2109-21diskmemload23:58:330
12047992321,1cyclictest15743-21munin-plugin-st19:25:000
12047992321,1cyclictest0-21swapper/023:30:010
12047992321,1cyclictest0-21swapper/022:35:020
12047992320,2cyclictest1214-21ssh21:28:080
1204799230,2cyclictest21334-21ssh22:15:500
1204799230,23cyclictest0-21swapper/023:42:410
1204799230,23cyclictest0-21swapper/022:42:060
1204799230,23cyclictest0-21swapper/022:26:350
1204799230,23cyclictest0-21swapper/022:08:350
1204799230,23cyclictest0-21swapper/022:08:350
1204799230,23cyclictest0-21swapper/000:37:150
1204799230,23cyclictest0-21swapper/000:05:490
1204799230,22cyclictest31365-21ssh22:25:010
1204799230,1cyclictest0-21swapper/021:11:450
12054992222,0cyclictest16634-21diskmemload21:58:423
12054992222,0cyclictest16634-21diskmemload00:07:483
12054992221,1cyclictest27826-21ssh23:21:303
12054992221,1cyclictest0-21swapper/321:41:473
12054992220,1cyclictest27275-21ssh23:50:503
12054992220,1cyclictest0-21swapper/322:01:543
1205499220,22cyclictest0-21swapper/322:35:163
1205499220,21cyclictest5247-21sh22:30:033
1205499220,21cyclictest21523-21ssh23:45:053
1205499220,21cyclictest16634-21diskmemload23:27:193
1205499220,1cyclictest29545-21hddtemp_smartct21:53:513
1205499220,1cyclictest10192-21cron23:35:003
1205499220,0cyclictest0-21swapper/323:01:343
1205499220,0cyclictest0-21swapper/321:20:073
12053992222,0cyclictest0-21swapper/223:27:472
12053992222,0cyclictest0-21swapper/223:05:112
12053992222,0cyclictest0-21swapper/222:55:172
12053992222,0cyclictest0-21swapper/222:45:192
12053992222,0cyclictest0-21swapper/222:35:082
12053992222,0cyclictest0-21swapper/221:38:142
12053992222,0cyclictest0-21swapper/221:21:312
12053992221,1cyclictest16634-21diskmemload23:36:292
12053992221,0cyclictest0-21swapper/223:13:392
12053992220,1cyclictest0-21swapper/220:20:002
1205399220,21cyclictest0-21swapper/221:33:342
1205399220,21cyclictest0-21swapper/221:27:592
1205399220,21cyclictest0-21swapper/221:16:212
1205399220,21cyclictest0-21swapper/200:01:192
1205399220,1cyclictest0-21swapper/222:17:552
12052992222,0cyclictest16634-21diskmemload00:05:421
12052992222,0cyclictest0-21swapper/100:31:321
12052992221,0cyclictest0-21swapper/119:38:441
12052992220,1cyclictest9943-21ssh21:35:071
12052992220,1cyclictest20194-21cron21:15:001
1205299220,22cyclictest0-21swapper/122:55:391
1205299220,21cyclictest0-21swapper/123:50:051
1205299220,21cyclictest0-21swapper/121:53:101
1205299220,1cyclictest0-21swapper/122:41:011
1205299220,1cyclictest0-21swapper/100:15:241
12047992222,0cyclictest0-21swapper/022:45:190
12047992221,1cyclictest16634-21diskmemload00:00:110
12047992221,1cyclictest0-21swapper/021:35:030
1204799220,22cyclictest16188-21ssh23:10:300
1204799220,22cyclictest0-21swapper/023:15:030
1204799220,21cyclictest16634-21diskmemload21:16:210
1204799220,21cyclictest0-21swapper/023:35:190
1204799220,21cyclictest0-21swapper/021:53:390
1204799220,21cyclictest0-21swapper/000:21:310
1204799220,0cyclictest0-21swapper/000:17:590
12054992121,0cyclictest13211-21apt-get19:18:453
12054992120,0cyclictest25411-21apt-get19:58:443
12054992119,1cyclictest7121-21munin-run20:40:013
1205499210,21cyclictest0-21swapper/300:21:193
1205499210,1cyclictest1004-21latency_hist20:20:003
1205499210,0cyclictest16634-21diskmemload00:15:323
1205399210,0cyclictest22372-21apt-get19:48:442
1205299210,21cyclictest0-21swapper/100:10:541
1205299210,0cyclictest2206-21apt-get20:28:451
12047992120,1cyclictest992-21turbostat20:20:000
1204799210,20cyclictest0-21swapper/020:48:450
1204799210,0cyclictest0-21swapper/019:48:440
12054992020,0cyclictest0-21swapper/321:08:463
12054992020,0cyclictest0-21swapper/320:28:453
12053992020,0cyclictest0-21swapper/219:18:452
12052992020,0cyclictest0-21swapper/120:38:441
12047992020,0cyclictest0-21swapper/019:18:450
12047992019,1cyclictest0-21swapper/020:28:450
12053991919,0cyclictest0-21swapper/220:28:452
12047991916,2cyclictest606-21dbus-daemon20:45:010
12054991818,0cyclictest0-21swapper/320:58:453
12054991818,0cyclictest0-21swapper/320:08:443
12054991816,1cyclictest0-21swapper/320:55:003
12054991815,2cyclictest14231-21cron21:05:003
12053991816,1cyclictest8160-21sh20:45:012
12052991818,0cyclictest0-21swapper/121:08:461
12052991818,0cyclictest0-21swapper/119:28:441
12047991818,0cyclictest0-21swapper/019:28:450
12054991717,0cyclictest0-21swapper/319:48:443
12054991717,0cyclictest0-21swapper/319:38:453
12053991717,0cyclictest0-21swapper/219:28:452
12053991716,0cyclictest8700-21apt-get20:48:452
12053991715,1cyclictest18787-21munin-run19:35:002
12052991715,1cyclictest31030-21grep20:15:001
12052991715,1cyclictest0-21swapper/121:00:001
12047991716,1cyclictest14804-21apt-get21:08:460
12047991715,1cyclictest0-21swapper/019:35:000
1205499160,15cyclictest30741-21chrt20:11:543
12053991616,0cyclictest0-21swapper/221:08:462
12053991616,0cyclictest0-21swapper/220:38:442
12053991614,1cyclictest0-21swapper/219:40:012
1205399160,15cyclictest14273-21munin-run21:05:002
12052991616,0cyclictest0-21swapper/120:18:451
12052991616,0cyclictest0-21swapper/119:48:441
12052991613,2cyclictest14251-21awk21:05:001
12047991616,0cyclictest5246-21apt-get20:38:440
12047991614,1cyclictest19315-21apt-get19:38:440
1204799160,15cyclictest14264-21perf21:05:000
12054991515,0cyclictest0-21swapper/320:48:453
12054991515,0cyclictest0-21swapper/320:40:023
1205499150,5cyclictest313-21systemd-journal19:55:013
1205399150,7cyclictest0-21swapper/219:58:442
1205299150,14cyclictest606-21dbus-daemon19:55:011
12047991515,0cyclictest0-21swapper/019:58:440
12047991514,0cyclictest0-21swapper/020:32:160
1204799150,14cyclictest0-21swapper/020:00:180
12054991414,0cyclictest0-21swapper/320:20:533
12054991414,0cyclictest0-21swapper/319:30:013
1205499140,14cyclictest0-21swapper/320:30:293
1205499140,14cyclictest0-21swapper/319:40:473
1205499140,14cyclictest0-21swapper/319:25:483
1205499140,0cyclictest0-21swapper/320:01:293
1205499140,0cyclictest0-21swapper/319:21:053
1205499140,0cyclictest0-21swapper/319:11:593
12053991414,0cyclictest0-21swapper/220:51:212
1205399140,14cyclictest0-21swapper/220:30:052
1205399140,14cyclictest0-21swapper/220:20:132
1205399140,14cyclictest0-21swapper/220:10:072
1205399140,14cyclictest0-21swapper/220:01:132
1205399140,14cyclictest0-21swapper/219:50:052
1205399140,14cyclictest0-21swapper/219:40:172
1205399140,0cyclictest0-21swapper/220:05:462
12052991414,0cyclictest0-21swapper/120:05:181
12052991414,0cyclictest0-21swapper/119:30:041
1205299140,14cyclictest0-21swapper/120:45:171
1205299140,14cyclictest0-21swapper/120:30:111
1205299140,14cyclictest0-21swapper/120:20:561
1205299140,14cyclictest0-21swapper/119:20:561
1205299140,0cyclictest0-21swapper/120:00:191
1205299140,0cyclictest0-21swapper/119:55:041
1205299140,0cyclictest0-21swapper/119:40:401
1204799140,14cyclictest0-21swapper/020:20:130
1204799140,14cyclictest0-21swapper/020:10:070
1204799140,14cyclictest0-21swapper/020:06:590
1204799140,14cyclictest0-21swapper/019:50:050
1204799140,14cyclictest0-21swapper/019:40:170
1204799140,0cyclictest0-21swapper/020:51:590
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional