You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-04 - 13:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot1.osadl.org (updated Wed Nov 04, 2026 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
528723212059,21sleep00-21swapper/019:10:000
528698212059,21sleep10-21swapper/119:09:411
522543211658,47sleep20-21swapper/219:05:062
1319981050,87rtkit-daemon0-21swapper/319:06:283
7901572420,1sleep10-21swapper/122:10:151
7276142270,5sleep3727619-21unixbench_multi21:30:383
131998200,3rtkit-daemon735-21mta-sts-daemon21:02:353
52894199195,2cyclictest0-21swapper/323:29:143
52894199180,5cyclictest587739-21grep19:50:523
52894099184,5cyclictest587693-21grep19:50:522
528940991812,5cyclictest691-21dbus-daemon23:55:022
9154332170,2sleep3471rcuc/323:20:353
52894099170,12cyclictest943453-21ssh23:40:052
52893899175,4cyclictest824041-21kworker/u16:0+ext4-rsv-conversion22:55:030
52893899171,2cyclictest161rcu_preempt22:39:260
52894199169,6cyclictest568400-21cron19:40:013
52894199163,12cyclictest0-21swapper/323:37:393
528941991615,1cyclictest0-21swapper/322:42:113
52893899160,5cyclictest900459-21cron23:15:010
52894199157,6cyclictest1-21systemd23:15:023
52894199151,13cyclictest943450-21apt-get23:40:063
52894199151,13cyclictest555567-21/usr/sbin/munin19:30:373
52894099159,4cyclictest687096-21diskmemload23:15:282
52893999159,5cyclictest838869-21users22:35:391
52893999150,3cyclictest814659-21ssh22:23:531
52893899157,2cyclictest9262921systemd-run23:30:020
52893899152,5cyclictest1318-21rtkit-daemon22:44:490
52893899150,5cyclictest948928-21ntp_states23:40:310
7383922140,1sleep10-21swapper/121:40:011
52894199147,6cyclictest0-21swapper/319:13:023
52894199147,2cyclictest0-21swapper/323:53:293
52894199147,2cyclictest0-21swapper/323:15:213
52894199147,2cyclictest0-21swapper/321:49:593
52894199147,2cyclictest0-21swapper/321:11:133
52894199146,2cyclictest0-21swapper/322:50:073
52894199146,2cyclictest0-21swapper/300:15:353
528941991413,1cyclictest0-21swapper/320:25:103
52894099148,3cyclictest687096-21diskmemload22:50:282
52894099147,2cyclictest161rcu_preempt22:20:282
52894099147,1cyclictest10037331cpuspeed_turbos00:15:252
52894099145,5cyclictest724359-21tr21:30:312
52894099144,5cyclictest928669-21kworker/u16:2+rpciod23:37:472
52894099143,4cyclictest1017130-21kworker/u16:0+xprtiod00:37:442
52894099140,9cyclictest688408-21ps21:10:282
52894099140,5cyclictest1034509-21pmu-power00:30:332
52893999146,6cyclictest691-21dbus-daemon00:20:031
52893999146,6cyclictest305-21systemd-journal00:10:021
52893999141,3cyclictest31-21ksoftirqd/120:05:081
528939991411,2cyclictest291rcuc/121:30:351
52893999140,7cyclictest686-21avahi-daemon23:30:561
52893999140,2cyclictest161rcu_preempt22:30:001
52893999140,13cyclictest977628-21apt-get00:00:071
52893899148,5cyclictest712703-21unix_chkpwd21:25:020
52893899147,5cyclictest305-21systemd-journal22:57:020
52893899146,2cyclictest161rcu_preempt21:45:280
52893899144,2cyclictest161rcu_preempt00:25:320
52893899143,2cyclictest889889-21grep23:05:360
52894199137,5cyclictest546753-21tr19:20:303
52894199137,5cyclictest0-21swapper/321:25:023
52894199137,2cyclictest0-21swapper/323:09:433
52894199137,2cyclictest0-21swapper/322:35:043
52894199137,2cyclictest0-21swapper/321:15:483
52894199137,2cyclictest0-21swapper/300:37:363
52894199136,2cyclictest0-21swapper/323:58:473
52894199136,2cyclictest0-21swapper/323:46:443
52894199136,2cyclictest0-21swapper/323:02:423
52894199136,2cyclictest0-21swapper/322:56:243
52894199136,2cyclictest0-21swapper/321:40:563
52894199136,2cyclictest0-21swapper/321:36:033
52894199136,2cyclictest0-21swapper/300:34:223
52894199136,2cyclictest0-21swapper/300:07:313
52894199136,2cyclictest0-21swapper/300:02:073
52894199135,2cyclictest0-21swapper/321:51:453
52894199134,8cyclictest999657-21cut00:10:283
52894199131,7cyclictest770793-21sshd-session21:56:143
528941991310,2cyclictest821191-21ps22:25:323
52894199130,6cyclictest611005-21cut20:10:313
52894099139,3cyclictest0-21swapper/223:45:372
52894099138,1cyclictest161rcu_preempt23:29:012
52894099137,5cyclictest705009-21df21:20:262
52894099137,5cyclictest634942-21grep20:30:232
52894099137,2cyclictest161rcu_preempt22:30:282
52894099137,2cyclictest161rcu_preempt00:25:282
52894099136,3cyclictest644871-21tr20:35:292
52894099135,7cyclictest739922-21cut21:40:272
52894099134,2cyclictest131998rtkit-daemon21:59:472
52894099133,4cyclictest959757-21kworker/u16:2+nfsiod23:58:062
52894099132,5cyclictest847321-21sh22:40:362
52894099132,4cyclictest726973-21kworker/u16:1+rpciod21:39:002
52894099131,4cyclictest3963368-21gmain20:18:332
52894099130,8cyclictest609127-21sed20:10:292
52894099130,7cyclictest910027-21grep23:20:242
52894099130,7cyclictest790522-21df22:10:252
52894099130,6cyclictest995384-21grep00:10:242
52894099130,5cyclictest0-21swapper/222:35:092
52894099130,2cyclictest542120-21systemctl19:20:012
52893999137,5cyclictest969104-21diskmemload23:55:071
52893999137,5cyclictest633850-21grep20:25:381
52893999136,6cyclictest907297-21diskmemload23:16:121
52893999136,6cyclictest853326-21cut22:45:291
52893999136,6cyclictest557031-21tr19:30:291
52893999136,5cyclictest695777-21cut21:15:021
52893999136,5cyclictest643408-21kthreadcore20:35:281
52893999136,5cyclictest305-21systemd-journal21:50:021
52893999136,5cyclictest1045069-21sh00:39:041
52893999136,2cyclictest161rcu_preempt23:40:161
52893999136,1cyclictest161rcu_preempt20:44:591
52893999136,1cyclictest161rcu_preempt20:44:591
52893999135,7cyclictest826307-21cut22:30:281
52893999135,7cyclictest716757-21cut21:25:281
52893999135,6cyclictest900670-21latency_hist23:15:021
52893999135,6cyclictest691-21dbus-daemon20:15:021
52893999135,6cyclictest691-21dbus-daemon19:25:031
52893999135,6cyclictest1-21systemd23:30:021
52893999135,6cyclictest1011946-21sh00:20:111
52893999135,3cyclictest864725-21ssh22:51:091
52893999135,2cyclictest161rcu_preempt23:45:161
52893999134,2cyclictest161rcu_preempt21:50:351
52893999134,2cyclictest161rcu_preempt19:40:331
52893999133,5cyclictest726973-21kworker/u16:1+xprtiod22:17:581
52893999133,2cyclictest161rcu_preempt23:50:291
52893999133,2cyclictest161rcu_preempt00:30:361
52893999133,1cyclictest161rcu_preempt22:55:281
528939991312,1cyclictest0-21swapper/123:22:551
52893999130,7cyclictest680779-21/usr/sbin/munin21:05:371
52893999130,6cyclictest704483-21/usr/sbin/munin21:20:101
52893899139,3cyclictest1001354-21ssh00:11:430
52893899136,6cyclictest305-21systemd-journal21:30:020
52893899136,5cyclictest691-21dbus-daemon00:00:030
52893899136,2cyclictest161rcu_preempt23:15:300
52893899135,7cyclictest1004745-21cut00:15:280
52893899135,2cyclictest161rcu_preempt23:00:300
52893899134,3cyclictest634200-21kworker/u16:0+xprtiod21:35:550
52893899133,2cyclictest161rcu_preempt19:50:020
52893899132,1cyclictest161rcu_preempt23:22:440
52893899131,4cyclictest548251-21unixbench_multi19:20:370
52893899131,4cyclictest1318-21rtkit-daemon19:50:370
52893899131,10cyclictest726247-21cut21:30:320
52893899130,6cyclictest957444-21tail23:45:320
52893899130,5cyclictest554758-21grep19:25:350
131998130,8rtkit-daemon999-21gmain22:12:563
52894199127,4cyclictest928722-21cut23:30:303
52894199126,5cyclictest691-21dbus-daemon20:40:003
52894199126,2cyclictest0-21swapper/322:22:563
52894199126,2cyclictest0-21swapper/322:15:543
52894199126,2cyclictest0-21swapper/321:26:053
52894199125,6cyclictest777117-21cut22:00:313
52894199125,6cyclictest665025-21tr20:50:273
52894199125,6cyclictest599919-21tr20:00:313
52894199125,6cyclictest1108-21lldpd20:15:083
52894199125,6cyclictest1012912-21sed00:20:273
52894199125,2cyclictest0-21swapper/300:26:483
52894199123,5cyclictest785923-21kthreadcore22:05:323
52894199121,4cyclictest654321-21munin-run20:45:033
52894199121,4cyclictest654321-21munin-run20:45:023
52894199120,7cyclictest594778-21920:00:013
52894099127,4cyclictest555948-21grep19:30:262
52894099126,5cyclictest758152-21cut21:50:282
52894099126,5cyclictest691-21dbus-daemon22:55:332
52894099126,5cyclictest589800-21tr19:55:582
52894099126,2cyclictest161rcu_preempt20:50:062
52894099126,1cyclictest986800-21gltestperf00:05:282
52894099125,6cyclictest883977-21cut23:05:102
52894099125,5cyclictest787646-21sh22:05:442
52894099125,5cyclictest753650-21diskmemload21:46:112
52894099125,5cyclictest1-21systemd19:45:012
52894099125,3cyclictest677229-21kthreadcore21:00:322
52894099124,7cyclictest1001-21gdbus19:40:022
52894099124,6cyclictest822713-21sh22:27:442
52894099124,6cyclictest681004-21cpu21:05:242
52894099124,6cyclictest305-21systemd-journal20:06:402
52894099123,5cyclictest780397-21runrttasks22:03:392
52894099123,5cyclictest656-17auditd19:30:012
52894099122,9cyclictest1434-21gnome-shell23:13:592
52894099122,6cyclictest622451-21sed20:20:272
52894099122,4cyclictest0-21swapper/219:20:312
52894099122,3cyclictest1089-21runrttasks21:16:112
52894099121,4cyclictest0-21swapper/200:00:302
52894099120,6cyclictest875821-21tr23:00:252
52894099120,6cyclictest854829-21kthreadcore22:45:302
52894099120,6cyclictest719118-21grep21:25:352
52894099120,6cyclictest673019-21tr20:55:342
52894099120,6cyclictest654806-21sort20:45:252
52894099120,4cyclictest628499-21fschecks_time20:25:282
52893999128,3cyclictest1000491-21sensors_temp00:10:321
52893999126,5cyclictest824-21rs:main1
52893999126,5cyclictest661250-21cpuspeed20:50:221
52893999126,5cyclictest621808-21df20:20:241
52893999126,5cyclictest588643-21sshd-session19:55:461
52893999126,3cyclictest778777-21wc22:00:361
52893999125,6cyclictest936830-21tr23:35:291
52893999125,6cyclictest740760-21cut21:40:281
52893999125,6cyclictest618471-21cut20:15:321
52893999125,6cyclictest597839-21tr20:00:301
52893999125,6cyclictest566714-21tr19:35:311
52893999125,6cyclictest531120-21cut19:10:421
52893999125,5cyclictest1027723-21sh00:28:181
52893999124,2cyclictest769723-21missed_timers21:55:321
52893999121,5cyclictest1318-21rtkit-daemon20:31:041
52893999121,2cyclictest161rcu_preempt22:05:311
52893999121,2cyclictest161rcu_preempt21:15:281
52893999120,8cyclictest575340-21sort19:45:051
52893999120,5cyclictest890401-21runrttasks23:06:351
52893899127,4cyclictest1434-21gnome-shell22:19:590
52893899126,5cyclictest664233-21tr20:50:280
52893899125,6cyclictest783029-21cut22:05:290
52893899125,6cyclictest767019-21cut21:55:290
52893899125,6cyclictest740604-21cut21:40:280
52893899125,6cyclictest696070-21aten2.4-expect21:15:160
52893899125,6cyclictest691-21dbus-daemon23:40:010
52893899125,6cyclictest541594-21cat19:15:340
52893899124,2cyclictest161rcu_preempt22:10:260
52893899124,2cyclictest161rcu_preempt00:35:340
52893899123,7cyclictest691-21dbus-daemon22:35:010
52893899123,2cyclictest161rcu_preempt00:05:260
52893899123,1cyclictest131998rtkit-daemon22:22:160
52893899122,2cyclictest161rcu_preempt21:50:070
52893899121,9cyclictest1434-21gnome-shell20:25:590
52893899121,5cyclictest891335-21kworker/u16:0+xprtiod23:31:300
52893899120,6cyclictest1015915-21tr00:20:300
52893899120,5cyclictest978174-21sort00:00:250
52893899120,5cyclictest616264-21tr20:15:300
52893899120,5cyclictest555730-21cut19:30:180
52893899120,4cyclictest1318-21rtkit-daemon20:30:070
52893899120,4cyclictest1036115-21ssh00:33:030
52893899120,3cyclictest854824-21cut22:45:290
52893899120,1cyclictest0-21swapper/020:20:060
52894199115,5cyclictest854194-21tr22:45:303
52894199115,5cyclictest305-21systemd-journal20:34:563
52894199115,2cyclictest0-21swapper/322:30:133
52894199114,6cyclictest539143-21kthreadcore19:15:293
52894199110,5cyclictest621885-21fschecks_time20:20:253
52894199110,5cyclictest1-21systemd19:50:033
52894099115,5cyclictest798638-21sh22:15:062
52894099115,5cyclictest653946-21seq20:43:472
52894099115,5cyclictest653946-21seq20:43:462
52894099115,5cyclictest598280-21kthreadcore20:00:302
52894099115,5cyclictest530682-21cut19:10:422
52894099114,5cyclictest578809-21kthreadcore19:45:282
52894099110,5cyclictest926457-21aten_repower_en23:30:122
52894099110,4cyclictest1012493-21grep00:20:252
52893999115,5cyclictest658298-21cut20:45:301
52893999114,6cyclictest583280-21tr19:50:441
52893999114,6cyclictest550860-21kthreadcore19:25:281
52893999113,7cyclictest539714-21tr19:15:281
52893999113,2cyclictest161rcu_preempt22:40:241
52893999111,2cyclictest161rcu_preempt21:00:161
52893999110,2cyclictest161rcu_preempt20:55:311
52893899116,4cyclictest598034-21kthreadcore20:00:300
52893899115,5cyclictest961613-21cut23:50:290
52893899115,5cyclictest818862-21tr22:25:300
52893899115,5cyclictest688636-21cut21:10:280
52893899115,5cyclictest659118-21tr20:45:300
52893899115,5cyclictest563495-21tr19:35:290
52893899115,5cyclictest534615-21phc2sys19:10:460
52893899114,6cyclictest773957-21cut22:00:300
52893899114,6cyclictest682340-21cut21:05:310
52893899114,6cyclictest670085-21tr20:55:290
52893899114,6cyclictest609930-21tr20:10:300
52893899114,6cyclictest570379-21cut19:40:340
52893899113,2cyclictest161rcu_preempt20:40:300
52893899113,2cyclictest161rcu_preempt20:40:290
52893899112,2cyclictest161rcu_preempt21:00:350
52893899111,9cyclictest0-21swapper/019:55:070
52893899111,8cyclictest641191-21/usr/sbin/munin20:35:340
52894199106,3cyclictest568756-21/usr/sbin/munin19:40:373
52894199104,5cyclictest681229-21grep21:05:263
52894199104,5cyclictest670838-21cut20:55:303
52894199104,5cyclictest654838-21cut20:45:263
52894199104,5cyclictest549098-21hostname19:25:103
52894199103,6cyclictest605717-21tr20:05:323
52893899101,7cyclictest601643-21/usr/sbin/munin20:05:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional