You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-25 - 14:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Sat Jul 25, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1889899310,22cyclictest0-21swapper/020:23:000
18898992920,3cyclictest0-21swapper/023:08:020
18903992624,1cyclictest0-21swapper/223:48:202
18903992622,3cyclictest15011-21cron21:40:012
1889899260,0cyclictest0-21swapper/021:53:510
1890799250,24cyclictest0-21swapper/323:25:303
1890799250,24cyclictest0-21swapper/322:50:453
1889899250,24cyclictest12933-21diskmemload22:17:460
18907992424,0cyclictest0-21swapper/300:10:083
1890799240,23cyclictest0-21swapper/321:11:303
1890799240,23cyclictest0-21swapper/300:15:113
1890799240,1cyclictest0-21swapper/323:16:403
18903992423,1cyclictest0-21swapper/200:18:442
18903992421,1cyclictest16633-21/usr/sbin/munin21:13:062
1890399240,23cyclictest0-21swapper/222:50:382
1890399240,21cyclictest0-21swapper/200:13:192
1890199240,23cyclictest0-21swapper/123:05:151
1890199240,0cyclictest12933-21diskmemload21:58:341
1890199240,0cyclictest0-21swapper/123:17:211
1889899242,21cyclictest12933-21diskmemload00:15:010
18898992422,1cyclictest0-21swapper/022:33:570
18898992421,2cyclictest12933-21diskmemload22:39:380
1889899240,23cyclictest7381-21apt-get22:03:010
1889899240,23cyclictest32068-21awk23:50:000
1889899240,23cyclictest12933-21diskmemload22:55:540
1889899240,23cyclictest12933-21diskmemload22:41:120
1889899240,23cyclictest12933-21diskmemload00:32:410
1889899240,23cyclictest0-21swapper/023:34:280
1889899240,23cyclictest0-21swapper/021:36:150
1889899240,1cyclictest6660-21cut21:33:040
18907992323,0cyclictest0-21swapper/322:42:373
18907992323,0cyclictest0-21swapper/321:41:463
18907992323,0cyclictest0-21swapper/321:39:093
18907992322,1cyclictest9503-21sh23:02:153
18907992322,1cyclictest0-21swapper/321:16:383
18907992321,1cyclictest12933-21diskmemload23:43:033
18907992321,1cyclictest0-21swapper/323:55:563
18907992321,1cyclictest0-21swapper/323:48:073
18907992321,1cyclictest0-21swapper/322:11:513
18907992321,1cyclictest0-21swapper/300:26:363
18907992321,1cyclictest0-21swapper/300:02:593
1890799230,2cyclictest12912-21sh22:36:173
1890799230,23cyclictest0-21swapper/323:35:023
1890799230,23cyclictest0-21swapper/322:00:473
1890799230,23cyclictest0-21swapper/321:20:023
1890799230,22cyclictest1899-21sh22:26:363
1890799230,22cyclictest13568-21fschecks_count22:08:033
1890799230,22cyclictest12933-21diskmemload21:30:453
1890799230,22cyclictest0-21swapper/323:08:033
1890799230,0cyclictest0-21swapper/323:21:223
18903992323,0cyclictest12933-21diskmemload23:55:592
18903992323,0cyclictest12933-21diskmemload23:00:442
18903992323,0cyclictest12933-21diskmemload21:15:152
18903992323,0cyclictest0-21swapper/221:50:242
18903992320,1cyclictest18012-21ssh22:40:322
1890399230,2cyclictest4965-21munin-run22:00:002
1890399230,23cyclictest0-21swapper/223:29:082
1890399230,23cyclictest0-21swapper/221:43:092
1890399230,23cyclictest0-21swapper/200:26:482
1890399230,22cyclictest25620-21ssh23:43:542
1890399230,22cyclictest2341-21ssh22:27:092
1890399230,22cyclictest0-21swapper/221:48:012
1890399230,1cyclictest611-21irqbalance22:23:462
1890399230,1cyclictest313-21systemd-journal20:15:002
1890399230,1cyclictest26942-21ssh23:17:332
1890399230,0cyclictest12933-21diskmemload22:36:102
1890399230,0cyclictest12933-21diskmemload22:04:292
1890399230,0cyclictest0-21swapper/221:22:122
18901992323,0cyclictest0-21swapper/123:50:191
18901992323,0cyclictest0-21swapper/123:33:221
18901992323,0cyclictest0-21swapper/123:25:291
1890199230,2cyclictest30900-21turbostat.cron20:40:001
1890199230,23cyclictest18324-21sh22:12:341
1890199230,23cyclictest12933-21diskmemload00:27:571
1890199230,23cyclictest0-21swapper/123:24:131
1890199230,23cyclictest0-21swapper/122:53:111
1890199230,23cyclictest0-21swapper/122:20:121
1890199230,23cyclictest0-21swapper/122:05:411
1890199230,22cyclictest7305-21cut21:33:091
1890199230,22cyclictest25217-21ssh21:20:131
1890199230,22cyclictest13400-21sh21:10:161
1890199230,22cyclictest10139-21ssh21:35:461
1890199230,22cyclictest0-21swapper/122:00:351
1890199230,1cyclictest0-21swapper/122:16:051
1890199230,0cyclictest12933-21diskmemload21:16:101
1890199230,0cyclictest0-21swapper/122:31:551
1890199230,0cyclictest0-21swapper/122:25:441
1890199230,0cyclictest0-21swapper/100:31:181
18898992323,0cyclictest12933-21diskmemload22:23:180
18898992323,0cyclictest12933-21diskmemload21:49:060
18898992323,0cyclictest0-21swapper/022:46:030
18898992323,0cyclictest0-21swapper/022:29:570
18898992323,0cyclictest0-21swapper/021:40:470
18898992323,0cyclictest0-21swapper/021:25:250
18898992323,0cyclictest0-21swapper/021:11:590
18898992321,1cyclictest12933-21diskmemload23:10:220
18898992321,1cyclictest0-21swapper/023:36:230
1889899230,2cyclictest3364-21sh21:58:110
1889899230,2cyclictest22997-21sh23:42:500
1889899230,23cyclictest0-21swapper/022:08:010
1889899230,23cyclictest0-21swapper/000:37:330
1889899230,22cyclictest3801-21turbostat.cron23:25:010
1889899230,22cyclictest0-21swapper/023:55:480
1889899230,1cyclictest17974-21rm00:06:380
1889899230,1cyclictest0-21swapper/000:29:230
1889899230,1cyclictest0-21swapper/000:10:030
1889899230,0cyclictest12933-21diskmemload23:17:510
1889899230,0cyclictest0-21swapper/023:53:170
1889899230,0cyclictest0-21swapper/023:26:240
1889899230,0cyclictest0-21swapper/021:16:500
18907992222,0cyclictest0-21swapper/323:13:143
18907992222,0cyclictest0-21swapper/322:20:233
18907992222,0cyclictest0-21swapper/321:50:383
18907992222,0cyclictest0-21swapper/319:15:033
18907992221,1cyclictest0-21swapper/300:07:413
18907992220,1cyclictest0-21swapper/322:55:243
18907992220,1cyclictest0-21swapper/322:45:253
18907992220,1cyclictest0-21swapper/300:35:533
18907992220,1cyclictest0-21swapper/300:30:023
18907992220,1cyclictest0-21swapper/300:22:483
1890799220,21cyclictest28502-21ls20:35:003
1890799220,21cyclictest16493-21wc20:10:013
1890799220,21cyclictest12933-21diskmemload23:31:533
1890799220,21cyclictest0-21swapper/322:30:263
1890799220,1cyclictest32560-21ssh23:50:213
1890799220,1cyclictest22409-21sh22:15:353
1890799220,1cyclictest0-21swapper/321:57:403
1890799220,1cyclictest0-21swapper/321:45:013
18903992222,0cyclictest12933-21diskmemload23:22:212
18903992222,0cyclictest12933-21diskmemload21:29:382
18903992222,0cyclictest0-21swapper/223:51:402
18903992221,1cyclictest12933-21diskmemload23:14:272
18903992220,1cyclictest30906-21sh20:40:002
18903992220,1cyclictest14588-21apt-get20:08:002
18903992220,1cyclictest0-21swapper/222:30:482
18903992220,1cyclictest0-21swapper/222:16:132
18903992220,1cyclictest0-21swapper/221:00:012
1890399220,22cyclictest19614-21ssh00:36:242
1890399220,22cyclictest12933-21diskmemload22:55:182
1890399220,22cyclictest0-21swapper/221:32:142
1890399220,21cyclictest9994-21ssh23:30:322
1890399220,21cyclictest14213-21ssh23:05:512
1890399220,21cyclictest11164-21ssh22:05:222
1890399220,21cyclictest0-21swapper/223:35:082
1890399220,1cyclictest18204-21ssh22:12:252
1890399220,1cyclictest0-21swapper/220:25:002
1890399220,0cyclictest0-21swapper/222:45:532
1890399220,0cyclictest0-21swapper/200:30:082
1890399220,0cyclictest0-21swapper/200:21:142
1890399220,0cyclictest0-21swapper/200:08:032
18901992222,0cyclictest0-21swapper/123:44:071
18901992222,0cyclictest0-21swapper/122:45:401
18901992222,0cyclictest0-21swapper/122:39:071
18901992222,0cyclictest0-21swapper/100:38:391
18901992221,1cyclictest3687-1kworker/u9:023:11:041
18901992221,1cyclictest12133-21sh00:01:111
1890199220,22cyclictest21685-21sh21:46:111
1890199220,22cyclictest0-21swapper/121:44:021
1890199220,22cyclictest0-21swapper/100:09:081
1890199220,21cyclictest24030-21cron19:20:011
1890199220,21cyclictest2269-21ssh22:55:211
1890199220,21cyclictest12933-21diskmemload22:40:411
1890199220,21cyclictest0-21swapper/121:53:321
1890199220,21cyclictest0-21swapper/100:20:431
1890199220,1cyclictest26856-21ssh23:45:171
1890199220,1cyclictest12946-21latency_hist21:10:001
1890199220,1cyclictest0-21swapper/123:55:151
1890199220,1cyclictest0-21swapper/121:26:201
1890199220,0cyclictest0-21swapper/100:17:141
18898992221,1cyclictest12173-21sh00:01:140
1889899220,21cyclictest29286-21sh22:50:310
1889899220,21cyclictest12933-21diskmemload21:20:210
1889899220,21cyclictest0-21swapper/022:12:020
1889899220,21cyclictest0-21swapper/000:20:260
1889899220,1cyclictest26094-21idleruntime-cro20:30:000
1889899220,1cyclictest0-21swapper/023:00:010
18907992120,0cyclictest0-21swapper/319:22:593
1890799210,20cyclictest0-21swapper/320:18:023
1890799210,20cyclictest0-21swapper/319:13:013
18903992121,0cyclictest0-21swapper/200:00:102
18903992120,1cyclictest9724-21apt-get19:58:012
18903992120,1cyclictest22136-21apt-get19:18:012
18903992120,0cyclictest31740-21apt-get19:38:012
1890399210,20cyclictest6934-21apt-get19:53:012
1890399210,1cyclictest0-21swapper/220:45:012
18901992121,0cyclictest4536-21apt-get19:48:011
18901992121,0cyclictest0-21swapper/123:00:141
1890199210,1cyclictest8083-21turbostat.cron21:00:011
1890199210,0cyclictest0-21swapper/119:13:011
1890199210,0cyclictest0-21swapper/100:10:271
18898992121,0cyclictest0-21swapper/020:53:010
18898992119,1cyclictest606-21dbus-daemon19:15:010
18907992020,0cyclictest0-21swapper/320:48:003
18907992020,0cyclictest0-21swapper/319:38:013
18907992019,1cyclictest0-21swapper/319:28:023
1890799200,1cyclictest0-21swapper/320:15:003
1890799200,0cyclictest1740-21apt-get19:42:593
1890799200,0cyclictest0-21swapper/320:58:023
18903992020,0cyclictest0-21swapper/220:03:002
18903992020,0cyclictest0-21swapper/219:22:592
1890399200,20cyclictest0-21swapper/220:33:012
18898992020,0cyclictest0-21swapper/020:03:000
1889899200,0cyclictest0-21swapper/021:08:000
1889899200,0cyclictest0-21swapper/021:03:030
1889899200,0cyclictest0-21swapper/020:48:000
1889899200,0cyclictest0-21swapper/020:38:010
1889899200,0cyclictest0-21swapper/019:33:010
18907991919,0cyclictest11045-21apt-get21:08:003
18907991919,0cyclictest0-21swapper/319:55:013
18903991919,0cyclictest0-21swapper/219:13:012
18901991918,1cyclictest26103-21perf20:30:001
18901991917,1cyclictest21307-21perf20:20:001
18898991919,0cyclictest0-21swapper/019:58:010
18898991917,1cyclictest8842-21basename19:55:010
18898991917,1cyclictest28514-21apt20:35:000
18907991818,0cyclictest0-21swapper/320:43:003
18903991818,0cyclictest0-21swapper/221:08:002
18903991818,0cyclictest0-21swapper/220:27:592
18903991818,0cyclictest0-21swapper/219:42:592
18901991818,0cyclictest12195-21apt-get20:03:001
18901991818,0cyclictest0-21swapper/120:48:001
1890199180,17cyclictest0-21swapper/119:33:011
18898991818,0cyclictest0-21swapper/019:18:010
18898991816,1cyclictest0-21swapper/019:38:010
1890799170,0cyclictest0-21swapper/320:38:023
18903991717,0cyclictest8602-21apt-get21:03:032
18903991717,0cyclictest0-21swapper/220:53:012
18903991715,1cyclictest313-21systemd-journal19:35:002
18901991717,0cyclictest8838-21apt-get19:55:021
18901991717,0cyclictest0-21swapper/121:03:031
18901991717,0cyclictest0-21swapper/119:53:011
18901991717,0cyclictest0-21swapper/119:42:591
18907991616,0cyclictest24195-21apt-get20:27:593
18907991616,0cyclictest0-21swapper/320:53:013
18907991615,1cyclictest1-21systemd20:00:013
18907991614,1cyclictest0-21swapper/320:05:013
18907991614,1cyclictest0-21swapper/319:35:003
1890799160,8cyclictest313-21systemd-journal19:45:173
18903991615,0cyclictest19390-21apt-get20:18:022
18901991616,0cyclictest3789-21apt-get20:53:011
18901991615,1cyclictest0-21swapper/120:35:001
18901991614,1cyclictest868-21cron20:45:011
1890199160,15cyclictest26271-21users19:23:091
1890199160,15cyclictest15213-21gltestperf20:08:021
18898991615,0cyclictest0-21swapper/019:28:020
1889899160,15cyclictest0-21swapper/019:43:010
1890799150,14cyclictest0-21swapper/321:00:153
18903991515,0cyclictest0-21swapper/219:28:022
18901991515,0cyclictest0-21swapper/120:13:011
18898991515,0cyclictest0-21swapper/019:22:590
1889899150,1cyclictest14588-21apt-get20:08:000
1890799140,14cyclictest0-21swapper/320:20:253
18903991414,0cyclictest0-21swapper/219:45:022
1890399140,14cyclictest0-21swapper/220:45:142
1890199140,14cyclictest0-21swapper/120:20:221
1890199140,14cyclictest0-21swapper/119:26:121
18898991414,0cyclictest0-21swapper/020:40:360
1889899140,14cyclictest0-21swapper/020:15:040
1889899140,14cyclictest0-21swapper/020:10:100
1889899140,14cyclictest0-21swapper/019:45:500
1889899140,0cyclictest0-21swapper/020:55:440
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional