You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 16:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Thu Jun 18, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31443993330,2cyclictest25189-21apt-get10:10:012
31436992826,1cyclictest15332-21apt-key09:30:011
3143099270,26cyclictest0-21swapper/012:30:040
3143099270,26cyclictest0-21swapper/009:49:330
31430992623,3cyclictest24931-21diskmemload12:00:540
3143099260,25cyclictest14725-21apt-get09:30:010
3143099260,21cyclictest19898-21apt-get10:35:010
3145099250,24cyclictest29683-21diskmemload09:42:573
3144399252,22cyclictest7911-21munin-plugin-st08:35:002
31443992522,2cyclictest5739-21sh09:20:162
3144399250,24cyclictest24931-21diskmemload10:33:182
3144399250,24cyclictest17713-21apt-get08:55:012
3144399250,24cyclictest0-21swapper/212:21:592
3144399250,1cyclictest14525-21ssh10:30:002
3144399250,0cyclictest151rcu_preempt12:05:582
31436992523,1cyclictest6143-21diskmemload11:50:551
3143699250,24cyclictest19866-21apt-get11:35:031
3143699250,24cyclictest0-21swapper/111:15:121
3143699250,24cyclictest0-21swapper/111:05:551
31430992523,1cyclictest11257-21users10:25:130
31430992520,4cyclictest0-21swapper/009:14:470
31430992519,5cyclictest25199-21apt-get10:40:020
31430992519,5cyclictest25199-21apt-get10:40:020
3143099250,24cyclictest0-21swapper/011:51:090
3143099250,24cyclictest0-21swapper/011:42:360
3143099250,21cyclictest0-21swapper/012:15:260
3143099250,21cyclictest0-21swapper/009:31:520
31450992423,1cyclictest783-21snmpd11:00:383
31450992423,1cyclictest19332-21apt-get12:35:003
31450992422,1cyclictest34-21ksoftirqd/307:45:003
31450992421,2cyclictest3557-21apt12:20:013
3145099241,22cyclictest622-21gdbus09:25:013
3145099241,22cyclictest3458-21sh09:49:393
3145099240,1cyclictest2693-21ssh11:18:473
31443992422,1cyclictest0-21swapper/211:35:032
31443992419,1cyclictest28174-21kworker/u8:010:50:012
3144399240,23cyclictest30610-21cron11:15:002
3144399240,23cyclictest24956-21perf09:10:002
3144399240,0cyclictest0-21swapper/209:41:462
31436992424,0cyclictest0-21swapper/109:29:041
31436992422,1cyclictest31396-21cstates09:45:001
31436992422,1cyclictest0-21swapper/108:45:021
3143699240,24cyclictest0-21swapper/110:13:201
3143699240,23cyclictest0-21swapper/109:05:001
3143699240,1cyclictest0-21swapper/111:03:131
3143699240,0cyclictest0-21swapper/109:45:391
3143699240,0cyclictest0-21swapper/109:24:371
31430992423,1cyclictest0-21swapper/011:06:170
31430992422,1cyclictest1706-21ssh09:17:200
31430992420,4cyclictest24931-21diskmemload11:10:080
31430992420,4cyclictest0-21swapper/011:46:080
31430992420,3cyclictest0-21swapper/011:20:060
31430992420,3cyclictest0-21swapper/010:58:070
31430992419,4cyclictest18620-21ssh11:02:580
31430992419,4cyclictest0-21swapper/010:45:410
31430992419,0cyclictest0-21swapper/007:35:010
3143099240,23cyclictest6549-21ssh09:21:340
3143099240,23cyclictest0-21swapper/012:28:080
3143099240,23cyclictest0-21swapper/009:42:530
3143099240,21cyclictest0-21swapper/011:25:330
3143099240,0cyclictest0-21swapper/012:35:020
31450992323,0cyclictest24931-21diskmemload09:17:563
31450992323,0cyclictest0-21swapper/311:58:393
31450992323,0cyclictest0-21swapper/311:50:563
31450992323,0cyclictest0-21swapper/311:22:023
31450992323,0cyclictest0-21swapper/311:12:483
31450992323,0cyclictest0-21swapper/310:31:283
31450992323,0cyclictest0-21swapper/309:37:483
31450992322,1cyclictest9374-21apt-get09:55:023
31450992321,1cyclictest25122-21sh10:39:583
3145099231,21cyclictest25275-21apt-get08:05:013
3145099230,2cyclictest27675-21ssh12:11:053
3145099230,23cyclictest0-21swapper/311:47:283
3145099230,23cyclictest0-21swapper/311:40:533
3145099230,23cyclictest0-21swapper/311:32:513
3145099230,23cyclictest0-21swapper/310:02:423
3145099230,23cyclictest0-21swapper/310:02:423
3145099230,22cyclictest6977-21rm09:51:543
3145099230,22cyclictest17935-21munin-run08:55:013
3145099230,22cyclictest0-21swapper/311:07:373
3145099230,1cyclictest15677-21apt08:50:013
3145099230,0cyclictest0-21swapper/310:47:073
31443992323,0cyclictest24931-21diskmemload11:59:522
31443992323,0cyclictest0-21swapper/212:01:372
31443992323,0cyclictest0-21swapper/209:11:472
31443992322,1cyclictest29754-21ssh10:13:202
31443992321,1cyclictest0-21swapper/211:40:032
31443992321,1cyclictest0-21swapper/209:55:422
31443992320,2cyclictest8729-21sh10:24:292
31443992320,2cyclictest14783-21rm10:00:012
31443992320,2cyclictest14783-21rm10:00:012
31443992319,2cyclictest313-21systemd-journal08:25:002
3144399231,21cyclictest3804-21cron07:20:012
3144399231,21cyclictest28-21ksoftirqd/208:15:012
3144399230,2cyclictest6469-21ssh10:51:022
3144399230,22cyclictest8213-21ssh09:53:422
3144399230,22cyclictest31418-21cat10:15:012
3144399230,22cyclictest27135-21ssh12:10:132
3144399230,22cyclictest14247-21ssh09:29:242
3144399230,22cyclictest1194-21ssh11:46:222
3144399230,22cyclictest0-21swapper/211:20:012
3144399230,1cyclictest0-21swapper/207:45:002
31436992323,0cyclictest0-21swapper/111:31:511
31436992323,0cyclictest0-21swapper/111:13:271
31436992323,0cyclictest0-21swapper/109:54:441
31436992321,1cyclictest3665-21sh10:49:471
31436992321,1cyclictest25567-21ssh11:40:011
31436992321,1cyclictest15678-21apt-get07:45:001
31436992321,1cyclictest14620-21ssh12:00:011
31436992321,1cyclictest0-21swapper/112:27:461
31436992321,1cyclictest0-21swapper/111:45:141
31436992320,2cyclictest25872-21apt-get10:40:031
31436992320,2cyclictest25872-21apt-get10:40:031
3143699230,23cyclictest0-21swapper/112:31:011
3143699230,23cyclictest0-21swapper/111:21:221
3143699230,23cyclictest0-21swapper/110:26:521
3143699230,22cyclictest19888-21perf10:35:001
3143699230,22cyclictest16712-21taskset10:00:241
3143699230,22cyclictest16712-21taskset10:00:241
3143699230,22cyclictest0-21swapper/111:25:051
3143699230,22cyclictest0-21swapper/109:35:111
3143699230,1cyclictest6234-21diskmemload12:21:291
3143699230,0cyclictest0-21swapper/112:37:281
3143699230,0cyclictest0-21swapper/111:55:561
3143699230,0cyclictest0-21swapper/109:55:021
31430992323,0cyclictest0-21swapper/012:22:450
31430992323,0cyclictest0-21swapper/012:05:260
31430992323,0cyclictest0-21swapper/009:50:250
31430992323,0cyclictest0-21swapper/009:05:000
31430992321,2cyclictest0-21swapper/010:08:390
31430992321,1cyclictest699-21date08:20:000
31430992321,1cyclictest0-21swapper/011:15:020
31430992320,3cyclictest0-21swapper/011:39:400
3143099230,2cyclictest10688-21sh07:35:000
3143099230,23cyclictest0-21swapper/011:56:180
3143099230,22cyclictest31387-21diskmemload10:15:010
3143099230,22cyclictest15316-21apt-get08:50:000
3143099230,22cyclictest11720-21sh09:56:010
3143099230,1cyclictest0-21swapper/010:50:140
3143099230,0cyclictest0-21swapper/010:34:510
3143099230,0cyclictest0-21swapper/010:13:150
3143099230,0cyclictest0-21swapper/010:03:280
3143099230,0cyclictest0-21swapper/010:03:280
31450992222,0cyclictest0-21swapper/311:36:033
31450992222,0cyclictest0-21swapper/310:56:143
31450992221,1cyclictest0-21swapper/308:10:003
31450992220,1cyclictest0-21swapper/312:20:023
31450992220,1cyclictest0-21swapper/309:25:073
31450992218,3cyclictest411-21cron08:20:003
3145099220,22cyclictest24931-21diskmemload10:15:453
3145099220,22cyclictest0-21swapper/312:39:373
3145099220,22cyclictest0-21swapper/309:12:303
3145099220,21cyclictest24931-21diskmemload10:50:483
3145099220,21cyclictest24931-21diskmemload10:05:253
3145099220,21cyclictest22523-21apt-get09:05:013
3145099220,21cyclictest1272-21munin-plugin-st07:15:013
3145099220,21cyclictest0-21swapper/311:25:023
3145099220,21cyclictest0-21swapper/310:40:033
3145099220,21cyclictest0-21swapper/310:40:033
3145099220,21cyclictest0-21swapper/310:25:023
3145099220,21cyclictest0-21swapper/310:20:243
3145099220,21cyclictest0-21swapper/310:10:033
3145099220,21cyclictest0-21swapper/307:25:023
3145099220,1cyclictest20043-21ssh09:34:303
3145099220,0cyclictest0-21swapper/312:26:003
31443992222,0cyclictest0-21swapper/211:50:022
31443992221,1cyclictest20171-21apt-get11:05:012
31443992221,1cyclictest0-21swapper/211:26:312
31443992220,1cyclictest32585-21timerwakeupswit09:15:102
31443992220,1cyclictest15625-21ntp_states11:30:072
31443992220,1cyclictest12473-21apt-get08:45:002
31443992220,1cyclictest0-21swapper/209:30:012
3144399220,22cyclictest16742-21rm12:31:092
3144399220,22cyclictest0-21swapper/210:41:252
3144399220,22cyclictest0-21swapper/210:41:252
3144399220,21cyclictest23583-21ssh12:38:282
3144399220,21cyclictest22590-21ssh09:35:212
3144399220,21cyclictest22533-21cron09:05:002
3144399220,21cyclictest12588-21apt-get08:45:022
3144399220,21cyclictest11350-21runrttasks10:55:232
3144399220,21cyclictest0-21swapper/210:35:012
3144399220,21cyclictest0-21swapper/208:05:012
3144399220,21cyclictest0-21swapper/207:25:022
3144399220,1cyclictest10720-21cut07:35:002
3144399220,1cyclictest0-21swapper/211:15:132
3144399220,0cyclictest0-21swapper/212:16:142
3144399220,0cyclictest0-21swapper/209:46:012
31436992222,0cyclictest0-21swapper/109:12:011
31436992221,1cyclictest0-21swapper/112:06:411
31436992221,1cyclictest0-21swapper/110:38:251
31436992220,1cyclictest5934-21munin-plugin-st07:25:011
31436992220,1cyclictest25316-21apt-config10:10:011
3143699220,21cyclictest7663-21apt-get08:34:591
3143699220,21cyclictest0-21swapper/112:10:071
3143699220,21cyclictest0-21swapper/110:55:321
3143699220,21cyclictest0-21swapper/107:55:011
3143699220,1cyclictest6636-21ssh10:51:161
3143699220,1cyclictest5264-21apt-get08:29:591
3143699220,1cyclictest456-21ssh09:15:231
3143699220,1cyclictest24917-21apt-get09:10:001
3143699220,1cyclictest0-21swapper/110:16:271
31430992220,1cyclictest17727-21chrt08:55:010
31430992220,1cyclictest15899-21munin-run07:45:000
3143099221,1cyclictest0-21swapper/012:10:080
3143099220,1cyclictest25017-21munin-run09:10:000
3143099220,0cyclictest0-21swapper/009:36:040
31450992121,0cyclictest0-21swapper/312:00:293
3145099210,20cyclictest0-21swapper/308:00:003
3145099210,20cyclictest0-21swapper/307:50:023
31443992119,1cyclictest27740-21sh08:10:012
3144399210,21cyclictest0-21swapper/211:00:092
3144399210,20cyclictest0-21swapper/208:00:002
3144399210,20cyclictest0-21swapper/207:15:012
31436992120,1cyclictest3501-21apt-get07:20:001
31436992120,1cyclictest20105-21apt-get08:59:591
3143699210,20cyclictest401-21apt-get08:20:001
3143699210,1cyclictest0-21swapper/110:20:171
31430992119,1cyclictest10111-21perf08:40:010
3143099210,20cyclictest0-21swapper/008:25:010
3143099210,0cyclictest0-21swapper/007:50:020
31450992020,0cyclictest5264-21apt-get08:29:593
31443992020,0cyclictest0-21swapper/208:29:592
31443992018,1cyclictest666-21munin-run08:20:002
31436992020,0cyclictest0-21swapper/108:55:011
31436992020,0cyclictest0-21swapper/108:10:001
31436992020,0cyclictest0-21swapper/108:00:001
31436992019,0cyclictest1093-21apt-get07:15:011
31436992018,1cyclictest30171-21awk08:15:011
31436992018,1cyclictest10718-21munin-run07:35:001
3143699200,20cyclictest0-21swapper/108:45:001
3143699200,0cyclictest0-21swapper/108:05:011
31430992020,0cyclictest0-21swapper/007:20:000
31430992019,0cyclictest0-21swapper/008:45:000
3143099200,20cyclictest0-21swapper/008:15:000
3143099200,0cyclictest27671-21apt-get08:10:000
3143099200,0cyclictest0-21swapper/008:35:000
31450991917,1cyclictest20556-21ls09:00:003
31443991919,0cyclictest0-21swapper/208:59:592
31436991919,0cyclictest0-21swapper/107:35:011
31436991917,1cyclictest8442-21perf07:30:011
31430991919,0cyclictest6173-21apt-get07:25:020
31430991919,0cyclictest20600-21apt-get07:55:010
31430991917,1cyclictest0-21swapper/008:05:010
31450991818,0cyclictest0-21swapper/308:20:013
31450991818,0cyclictest0-21swapper/307:20:003
31450991816,1cyclictest10116-21munin-run08:40:013
31430991817,0cyclictest0-21swapper/008:59:590
31450991717,0cyclictest10963-21apt-get07:35:013
31450991717,0cyclictest0-21swapper/308:45:003
31450991717,0cyclictest0-21swapper/308:35:003
31443991716,0cyclictest10058-21apt-get08:40:002
31430991715,1cyclictest18080-21perf07:50:000
3143099170,16cyclictest5900-21idleruntime-cro07:25:010
31450991616,0cyclictest30063-21apt-get08:15:003
3143099160,15cyclictest32415-21ntp_states07:10:050
31443991515,0cyclictest0-21swapper/207:35:012
31443991513,1cyclictest4323-21perl07:20:022
31436991515,0cyclictest0-21swapper/108:40:001
3145099140,14cyclictest0-21swapper/307:46:083
3145099140,14cyclictest0-21swapper/307:30:253
3145099140,14cyclictest0-21swapper/307:20:153
3144399142,8cyclictest18324-21apt-get07:50:022
3144399140,14cyclictest0-21swapper/207:46:542
3143699140,14cyclictest0-21swapper/108:20:231
31430991414,0cyclictest0-21swapper/008:20:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional