You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 15:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot4.osadl.org (updated Wed Nov 26, 2025 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2979484995046,2cyclictest3119718-21fwupd09:21:491
2979482993936,2cyclictest136-1kworker/0:1H+kblockd09:21:500
2979490993027,2cyclictest0-21swapper/312:00:013
297948899309,20cyclictest0-21swapper/209:30:002
297948499280,3cyclictest0-21swapper/112:28:361
297949099261,21cyclictest3127618-21fw_conntrack09:30:143
297948499262,21cyclictest3127323-21apt-get09:30:121
297948499261,5cyclictest3328692-21apt-get12:10:011
297948299261,23cyclictest3471731-21systemd-journal11:59:590
2979488992518,5cyclictest3328688-21latency_hist12:10:012
297948899250,5cyclictest3176697-21ssh10:06:472
2979484992520,3cyclictest3152124-21dump-pmu-power09:50:011
297948499251,21cyclictest3316464-21apt-get12:00:121
297948499251,21cyclictest3247342-21apt-get11:05:111
297948499251,21cyclictest2989881-21apt-get07:20:131
297948499250,22cyclictest3266462-21grep11:20:141
297948499250,21cyclictest0-21swapper/107:30:131
297948299250,5cyclictest3209924-21/usr/sbin/munin10:35:160
2979490992420,3cyclictest3259908-21apt-get11:15:133
2979490992419,2cyclictest3146131-21ssh09:45:153
2979490992418,3cyclictest3152588-21df09:50:133
297949099240,22cyclictest3272195-21munin-run11:24:593
297949099240,20cyclictest3360871-21apt-get12:35:113
297948899242,20cyclictest0-21swapper/212:00:142
2979488992420,2cyclictest3133621-21apt-get09:35:112
2979488992420,2cyclictest2994908-21apt-get07:25:102
297948899241,3cyclictest3188398-21ntpq10:15:222
297948899241,3cyclictest2989622-21munin-run07:20:012
297948899241,21cyclictest3091968-21apt-get09:00:112
297948899241,21cyclictest3091968-21apt-get09:00:112
297948899240,5cyclictest3316161-21awk12:00:002
297948899240,22cyclictest3228834-21basename10:50:152
297948899240,22cyclictest3071360-21idleruntime-cro08:40:002
297948499244,1cyclictest0-21swapper/111:45:071
2979484992419,3cyclictest3025458-21apt-get07:55:121
297948499241,21cyclictest3101861-21diskmemload11:59:241
297948499241,20cyclictest0-21swapper/111:15:121
297948499241,20cyclictest0-21swapper/110:35:031
297948499240,22cyclictest3139456-21ssh09:39:441
297948499240,21cyclictest0-21swapper/109:10:131
297948499240,21cyclictest0-21swapper/108:15:121
297948499240,20cyclictest3196909-21ssh10:25:121
297948499240,20cyclictest0-21swapper/111:00:121
297948499240,20cyclictest0-21swapper/107:45:131
297948299242,2cyclictest3354577-21apt-get12:30:110
2979482992420,2cyclictest3329424-21apt-get12:10:110
2979482992420,2cyclictest3241065-21apt-get11:00:120
2979482992420,2cyclictest3222121-21apt-get10:45:130
2979482992418,4cyclictest3306243-21ssh11:50:190
297948299240,22cyclictest3134132-21sed09:35:150
2979490992319,3cyclictest3259303-21ssh11:14:133
2979490992319,2cyclictest3101861-21diskmemload10:40:353
2979490992319,2cyclictest3076683-21apt-get08:45:143
297949099231,2cyclictest3101861-21diskmemload12:19:063
297949099231,2cyclictest3101861-21diskmemload11:34:153
297949099231,20cyclictest3329726-21fw_forwarded_lo12:10:153
297949099231,19cyclictest3114751-21apt-get09:20:113
297949099230,22cyclictest3302391-21ssh11:46:093
297949099230,21cyclictest3240026-21ssh10:57:493
297949099230,21cyclictest3177698-21cron10:10:003
297949099230,21cyclictest3134393-21sed09:35:153
297949099230,20cyclictest3316968-21ps12:00:163
297949099230,20cyclictest0-21swapper/309:25:163
297948899232,20cyclictest3144907-21sh09:42:052
2979488992319,3cyclictest3165572-21cut10:00:162
2979488992318,4cyclictest3015772-21irqcore07:45:182
2979488992318,3cyclictest3223407-21cut10:45:172
297948899231,3cyclictest3101861-21diskmemload09:52:382
297948899231,2cyclictest3101861-21diskmemload11:13:472
297948899231,2cyclictest0-21swapper/212:35:232
297948899231,2cyclictest0-21swapper/211:50:132
297948899231,21cyclictest3101861-21diskmemload11:45:412
297948899231,21cyclictest3101861-21diskmemload11:00:132
297948899231,21cyclictest3101861-21diskmemload09:30:492
297948899230,22cyclictest3291381-21ssh11:40:132
297948899230,22cyclictest3265507-21ssh11:18:492
297948899230,22cyclictest3076404-21cron08:45:002
297948899230,21cyclictest3003961-21chrt07:30:222
2979484992321,1cyclictest0-21swapper/110:50:491
2979484992319,2cyclictest3297359-21munin-run11:45:001
2979484992319,2cyclictest3203243-21apt-get10:30:141
2979484992319,2cyclictest3184356-21ssh10:15:131
2979484992319,2cyclictest3165053-21apt-get10:00:111
2979484992319,2cyclictest0-21swapper/107:35:121
297948499231,2cyclictest3101861-21diskmemload10:10:061
297948499231,20cyclictest3101861-21diskmemload10:56:341
297948499231,19cyclictest0-21swapper/108:55:131
297948499230,3cyclictest3110246-21cut09:15:191
297948499230,2cyclictest3259589-21idleruntime-cro11:14:591
297948499230,22cyclictest3126819-21ssh09:29:241
297948499230,21cyclictest3066277-21cron08:34:591
297948499230,20cyclictest3335731-21ssh12:15:131
297948499230,20cyclictest3071610-21apt-get08:40:141
297948499230,20cyclictest0-21swapper/112:20:121
297948499230,20cyclictest0-21swapper/110:45:121
297948499230,20cyclictest0-21swapper/108:10:111
297948499230,20cyclictest0-21swapper/107:50:121
297948499230,20cyclictest0-21swapper/107:40:121
2979482992319,2cyclictest3266207-21apt-get11:20:120
2979482992318,4cyclictest3234142-21ssh10:54:110
2979482992318,4cyclictest3164733-21ssh09:59:590
2979482992318,3cyclictest3197058-21df10:25:120
297948299231,2cyclictest3101861-21diskmemload11:48:430
297948299231,21cyclictest3101861-21diskmemload12:29:570
297948299231,21cyclictest3101861-21diskmemload09:16:240
297948299231,21cyclictest3015286-21apt-get07:45:130
297948299230,22cyclictest3260970-21kthreadcore11:15:170
297948299230,21cyclictest3219870-21ntpq10:40:220
297948299230,21cyclictest3101861-21diskmemload11:30:040
297948299230,20cyclictest3101861-21diskmemload09:25:030
297948299230,20cyclictest0-21swapper/012:05:020
2979490992219,2cyclictest3101861-21diskmemload11:25:433
2979490992219,2cyclictest3101861-21diskmemload10:00:123
2979490992219,2cyclictest0-21swapper/309:10:143
2979490992219,1cyclictest0-21swapper/308:35:113
297949099221,20cyclictest3101861-21diskmemload11:06:463
297949099220,2cyclictest3213769-21sed10:35:233
297949099220,2cyclictest3101861-21diskmemload12:34:373
297949099220,21cyclictest3291040-21ssh11:39:583
297949099220,21cyclictest3114412-21ssh09:19:573
297949099220,21cyclictest3101861-21diskmemload10:31:123
297949099220,19cyclictest0-21swapper/312:25:113
297949099220,19cyclictest0-21swapper/311:00:043
297949099220,19cyclictest0-21swapper/308:20:133
297949099220,19cyclictest0-21swapper/307:45:133
2979488992219,2cyclictest3352232-21chrt12:25:202
2979488992219,2cyclictest3046185-21apt-get08:15:132
2979488992219,2cyclictest3010186-21apt-get07:40:122
2979488992218,2cyclictest3213326-21ssh10:35:182
2979488992218,2cyclictest3146129-21ssh09:45:152
2979488992216,4cyclictest3335731-21ssh12:15:132
297948899221,20cyclictest3101861-21diskmemload11:31:372
297948899221,20cyclictest3101861-21diskmemload10:59:202
297948899221,20cyclictest0-21swapper/211:35:102
297948899221,20cyclictest0-21swapper/211:25:142
297948899221,1cyclictest3101861-21diskmemload10:28:132
297948899221,1cyclictest0-21swapper/210:10:142
297948899220,2cyclictest3358646-21ntpq12:30:212
297948899220,2cyclictest3253276-21latency_hist11:10:002
297948899220,2cyclictest3158750-21ssh09:55:132
297948899220,21cyclictest3194625-21ssh10:20:212
297948899220,21cyclictest3101861-21diskmemload11:20:382
297948899220,21cyclictest3101861-21diskmemload10:32:492
297948899220,21cyclictest0-21swapper/212:10:242
297948899220,1cyclictest3030652-21apt-config08:00:002
2979484992220,1cyclictest3101861-21diskmemload10:08:311
2979484992219,2cyclictest0-21swapper/108:45:121
2979484992218,2cyclictest3364900-21ssh12:35:211
2979484992217,3cyclictest3329342-21sh12:10:011
297948499221,2cyclictest3101861-21diskmemload10:41:411
297948499221,20cyclictest0-21swapper/112:31:121
297948499220,2cyclictest0-21swapper/109:55:121
297948499220,21cyclictest3101861-21diskmemload11:37:161
297948499220,21cyclictest0-21swapper/111:25:211
297948499220,20cyclictest311ktimers/111:50:171
297948499220,19cyclictest0-21swapper/110:20:121
297948499220,19cyclictest0-21swapper/108:25:121
2979482992219,2cyclictest3277638-21ssh11:27:130
2979482992219,2cyclictest3101861-21diskmemload11:43:330
2979482992219,2cyclictest3101861-21diskmemload10:02:190
2979482992219,2cyclictest3081782-21apt-get08:50:120
2979482992219,2cyclictest0-21swapper/010:57:380
297948299221,2cyclictest3101861-21diskmemload10:30:470
297948299221,2cyclictest3101861-21diskmemload09:51:450
297948299221,20cyclictest3101861-21diskmemload12:24:090
297948299221,20cyclictest3101861-21diskmemload10:11:030
297948299221,20cyclictest0-21swapper/012:00:120
297948299221,20cyclictest0-21swapper/009:10:130
297948299221,20cyclictest0-21swapper/007:20:140
297948299221,20cyclictest0-21swapper/007:15:250
297948299220,2cyclictest3101861-21diskmemload12:35:040
297948299220,21cyclictest3341150-21ssh12:18:180
297948299220,21cyclictest3194750-21ps10:20:240
297948299220,21cyclictest3184896-21sed10:15:170
297948299220,21cyclictest3030296-21true07:59:590
297948299220,21cyclictest0-21swapper/009:31:160
297948299220,20cyclictest3285082-21apt-get11:35:130
2979490992119,1cyclictest3101861-21diskmemload11:50:063
2979490992119,1cyclictest3101861-21diskmemload10:15:243
2979490992119,1cyclictest3101861-21diskmemload09:58:493
2979490992119,1cyclictest0-21swapper/310:52:353
2979490992119,1cyclictest0-21swapper/310:25:323
2979490992119,1cyclictest0-21swapper/309:40:283
2979490992119,1cyclictest0-21swapper/309:00:113
2979490992119,1cyclictest0-21swapper/309:00:103
2979490992119,1cyclictest0-21swapper/308:00:143
2979490992118,2cyclictest491ktimers/307:59:593
2979490992118,2cyclictest3022614-21kthreadcore07:50:173
2979490992117,2cyclictest3322719-21ssh12:05:113
297949099211,19cyclictest3041573-21grep08:10:153
297949099210,20cyclictest3195464-21ssh10:21:243
297949099210,1cyclictest3178013-21ssh10:10:143
297949099210,1cyclictest0-21swapper/312:22:223
297949099210,1cyclictest0-21swapper/310:45:103
2979488992119,1cyclictest0-21swapper/209:15:142
2979488992119,1cyclictest0-21swapper/208:20:132
2979488992113,2cyclictest191rcu_preempt08:10:202
297948899210,20cyclictest64-21kcompactd008:25:192
297948899210,20cyclictest3101861-21diskmemload09:10:202
297948899210,20cyclictest0-21swapper/209:20:292
297948899210,20cyclictest0-21swapper/208:50:112
297948899210,20cyclictest0-21swapper/208:30:132
297948899210,20cyclictest0-21swapper/208:05:132
297948899210,1cyclictest0-21swapper/212:20:372
2979484992118,2cyclictest3101861-21diskmemload11:31:181
297948499210,2cyclictest0-21swapper/109:00:111
297948499210,2cyclictest0-21swapper/109:00:101
297948499210,20cyclictest64-21kcompactd007:13:491
297948499210,1cyclictest0-21swapper/109:50:241
297948499210,1cyclictest0-21swapper/108:20:141
297948499210,1cyclictest0-21swapper/107:25:101
2979482992119,1cyclictest0-21swapper/008:40:150
2979482992119,1cyclictest0-21swapper/007:35:120
2979482992118,2cyclictest3101861-21diskmemload09:40:390
2979482992118,2cyclictest3041087-21apt-get08:10:110
2979482992118,2cyclictest245621450irq/127-enp0s29f1:rx-011:10:160
2979482992118,1cyclictest3171040-21apt-get10:05:020
297948299210,2cyclictest3031461-21tr08:00:160
297948299210,20cyclictest245621450irq/127-enp0s29f1:rx-009:45:240
297948299210,20cyclictest0-21swapper/011:06:410
2979490992018,1cyclictest0-21swapper/311:41:013
2979490992018,1cyclictest0-21swapper/308:55:133
2979490992018,1cyclictest0-21swapper/307:25:093
2979490992018,1cyclictest0-21swapper/307:15:143
2979490992018,1cyclictest0-21swapper/307:10:133
297949099200,1cyclictest0-21swapper/308:50:113
297949099200,1cyclictest0-21swapper/308:15:393
297949099200,19cyclictest0-21swapper/309:05:153
297949099200,19cyclictest0-21swapper/308:07:343
2979488992018,1cyclictest3020383-21apt-get07:50:122
2979488992016,2cyclictest3101861-21diskmemload10:40:032
297948899200,19cyclictest0-21swapper/208:55:122
297948899200,19cyclictest0-21swapper/208:00:132
2979482992018,1cyclictest0-21swapper/008:45:120
2979482992018,1cyclictest0-21swapper/008:15:110
2979482992016,2cyclictest2984531-21sh07:15:000
297948299200,1cyclictest64-21kcompactd008:58:060
297948299200,19cyclictest0-21swapper/008:05:140
2979490991917,1cyclictest0-21swapper/308:30:103
2979490991916,2cyclictest3072108-21grep08:40:183
2979490991916,2cyclictest0-21swapper/308:25:123
2979490991915,2cyclictest2990368-21grep07:20:183
2979488991916,2cyclictest2990384-21irqcore07:20:182
2979482991917,1cyclictest0-21swapper/009:05:110
2979482991917,1cyclictest0-21swapper/008:35:110
2979490991815,2cyclictest3005462-21gltestperf07:35:153
2979484991816,1cyclictest2984805-21apt-get07:15:161
2979482991816,1cyclictest0-21swapper/009:00:170
2979482991816,1cyclictest0-21swapper/009:00:160
2979488991715,1cyclictest3080660-21ntpq08:45:232
2979484991715,1cyclictest0-21swapper/108:04:531
2979484991712,3cyclictest3471731-21systemd-journal08:40:011
2979482991714,2cyclictest245621450irq/127-enp0s29f1:rx-007:50:150
2979482991713,3cyclictest245621450irq/127-enp0s29f1:rx-008:30:110
2979482991710,5cyclictest3471731-21systemd-journal07:30:000
2979488991616,0cyclictest0-21swapper/207:15:002
2979488991614,1cyclictest0-21swapper/209:05:112
2979482991614,1cyclictest0-21swapper/007:32:050
2979482991613,2cyclictest245621450irq/127-enp0s29f1:rx-007:40:170
2979482991612,3cyclictest245621450irq/127-enp0s29f1:rx-008:20:150
2979490991511,3cyclictest3003997-21ntp_offset07:30:223
2979484991511,3cyclictest3101086-21proc_pri09:05:221
297948499151,11cyclictest3040815-21awk08:09:591
2979490991413,0cyclictest0-21swapper/307:40:123
2979484991410,2cyclictest0-21swapper/108:50:151
297948899118,1cyclictest3005085-21apt-get07:35:122
297948299106,3cyclictest3056865-21irqcore08:25:160
29794849990,8cyclictest2979415-21latency_hist07:10:001
29794909973,3cyclictest2979514-21wc07:10:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional