You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-19 - 05:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackeslot2.osadl.org (updated Fri Sep 19, 2025 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
291600121220,2sleep30-21swapper/321:04:313
31850882950,2sleep20-21swapper/223:39:282
30853332860,2sleep20-21swapper/222:41:202
29259092820,1sleep10-21swapper/121:10:021
29216592340,2sleep30-21swapper/321:09:323
30046462320,2sleep30-21swapper/321:54:483
29673292300,2sleep30-21swapper/321:34:323
2783560992718,8cyclictest1610-21gmain23:25:011
278356099259,4cyclictest2937503-21apt21:19:241
278356099249,4cyclictest0-21swapper/122:54:231
2783560992413,10cyclictest2949139-21kthreadcore21:24:341
2783560992413,10cyclictest2949139-21kthreadcore21:24:341
797898230,3rtkit-daemon1646-1atopacctd00:03:460
278356099239,3cyclictest3044456-21kthreadcore22:19:301
2783560992315,7cyclictest2888812-21systemd-run20:35:001
2783560992310,3cyclictest3017149-21cstates22:04:301
797898220,3rtkit-daemon2789654-21munin-node19:34:420
2783560992213,8cyclictest1715-21systemd-logind19:45:001
2783560992212,9cyclictest3092643-21timerwakeupswit22:44:361
2783560992212,9cyclictest3065271-21kthreadcore22:29:341
2783559992219,2cyclictest3145903-21http23:15:010
2783559992219,2cyclictest3145903-21http23:15:010
2783559992210,10cyclictest0-21swapper/021:24:260
2783559992210,10cyclictest0-21swapper/021:24:260
278356099217,3cyclictest0-21swapper/121:44:311
2783560992113,7cyclictest3013621-21sh22:00:001
2783560992112,2cyclictest3260202-21apt-key00:20:011
2783560992112,2cyclictest3260202-21apt-key00:20:011
2783560992112,2cyclictest3216456-21systemd-run23:55:011
2783560992111,2cyclictest3176099-21uniq23:34:291
2783560992111,2cyclictest3030142-21kthreadcore22:09:331
2783560992111,2cyclictest0-21swapper/119:15:021
2783560992110,3cyclictest2906382-21ptp4l20:49:341
2783559992110,6cyclictest0-21swapper/021:39:370
797898200,3rtkit-daemon2789654-21munin-node20:04:450
797898200,2rtkit-daemon0-21swapper/022:37:300
2783561992017,2cyclictest0-21swapper/200:35:012
2783561992017,1cyclictest0-21swapper/221:24:342
2783561992017,1cyclictest0-21swapper/221:24:342
2783561992017,1cyclictest0-21swapper/200:20:012
2783561992017,1cyclictest0-21swapper/200:20:012
278356099209,3cyclictest2915254-21irqcore21:04:291
278356099205,8cyclictest2838928-21tr19:54:331
278356099202,4cyclictest176650irq/121-eno100:32:261
2783560992017,2cyclictest3057878-21cron22:25:001
2783560992014,2cyclictest176650irq/121-eno100:04:241
2783560992012,7cyclictest2864062-21timerandwakeup20:14:351
2783560992012,2cyclictest2969683-21latency_hist21:35:001
2783560992011,3cyclictest3204107-21kthreadcore23:49:311
2783560992011,2cyclictest3149727-21sh23:19:281
2783560992011,2cyclictest1703-21in:imuxsock19:35:021
2783560992010,3cyclictest3290587-21grep00:39:291
2783560992010,3cyclictest2874504-21kthreadcore20:24:311
2783560992010,2cyclictest2888979-21kworker/u16:0-rpciod21:49:361
2783559992018,1cyclictest3198792-21awk23:45:000
278355999201,5cyclictest0-21swapper/021:29:240
2783559992013,6cyclictest2004-21runrttasks23:31:320
2783559992012,4cyclictest260-21systemd-journal22:40:030
797898190,5rtkit-daemon8024-21sendmail-mta19:52:280
797898190,3rtkit-daemon2789654-21munin-node22:16:220
797898190,3rtkit-daemon2789654-21munin-node20:13:590
2783561991916,1cyclictest0-21swapper/223:34:292
278356099199,3cyclictest2910162-21kthreadcore20:59:251
278356099196,2cyclictest176650irq/121-eno122:59:261
278356099191,7cyclictest1633-21dbus-daemon19:40:021
278356099191,6cyclictest2978400-21latency_hist21:40:011
2783560991912,6cyclictest3137284-21latency_hist23:10:011
2783560991911,2cyclictest2840888-21aten_repower_en19:59:251
2783560991911,2cyclictest2829807-21irqcore19:49:281
2783560991910,2cyclictest3275485-21kthreadcore00:29:311
2783560991910,2cyclictest3013750-21kworker/u16:3-rpciod22:14:371
2783559991916,2cyclictest3110999-21sh22:55:020
2783559991914,4cyclictest2900893-21basename20:45:000
2783559991912,6cyclictest0-21swapper/021:15:020
2783559991910,2cyclictest0-21swapper/023:29:250
2555591190,2phc2sys0-21swapper/322:09:013
797898180,2rtkit-daemon2021-21snmpd20:48:550
278356199181,9cyclictest0-21swapper/220:20:012
2783561991815,2cyclictest0-21swapper/223:15:032
2783561991815,2cyclictest0-21swapper/223:15:032
2783561991815,1cyclictest0-21swapper/223:27:562
2783561991815,1cyclictest0-21swapper/222:55:002
2783561991815,1cyclictest0-21swapper/221:13:292
2783561991815,1cyclictest0-21swapper/219:34:252
2783561991815,1cyclictest0-21swapper/219:29:292
2783561991815,1cyclictest0-21swapper/200:24:292
2783561991815,1cyclictest0-21swapper/200:04:362
2783561991815,1cyclictest0-21swapper/200:00:022
278356099189,2cyclictest0-21swapper/119:20:011
278356099188,3cyclictest3140741-21sort23:14:271
278356099188,3cyclictest3140741-21sort23:14:271
278356099181,6cyclictest2803918-21latency_hist19:25:021
2783560991810,2cyclictest3195561-21kthreadcore23:44:331
2783560991810,2cyclictest3074054-21kthreadcore22:34:331
2783560991810,2cyclictest2931538-21kthreadcore21:14:341
2783559991815,2cyclictest2952204-21kworker/u16:1-rpciod22:05:000
2783559991815,2cyclictest2810025-21systemd-run19:30:010
2783559991815,2cyclictest1-21systemd00:15:010
2783559991812,5cyclictest3190130-21systemd-run23:40:010
2783559991811,4cyclictest3061101-21cpuspeed22:29:250
2555591181,2phc2sys0-21swapper/322:47:003
2555591180,2phc2sys0-21swapper/322:51:133
797898170,3rtkit-daemon1625-21avahi-daemon23:55:411
2783561991715,1cyclictest0-21swapper/219:40:012
2783561991714,2cyclictest0-21swapper/222:05:022
2783561991714,1cyclictest0-21swapper/223:05:002
2783561991714,1cyclictest0-21swapper/222:35:012
2783561991714,1cyclictest0-21swapper/222:20:022
2783561991714,1cyclictest0-21swapper/220:55:022
2783561991714,1cyclictest0-21swapper/220:34:392
2783561991713,2cyclictest0-21swapper/219:15:002
278356199171,12cyclictest0-21swapper/222:29:242
278356099178,5cyclictest351ktimers/121:51:561
278356099171,7cyclictest3251508-21cat00:15:011
2783560991714,2cyclictest1-21systemd22:50:011
2783560991713,3cyclictest1633-21dbus-daemon23:30:011
2783560991710,2cyclictest3126499-21kthreadcore23:04:311
2783560991710,2cyclictest2853583-21gltestperf20:09:271
2783560991710,1cyclictest2783557-21cyclictest23:37:041
278355999179,7cyclictest0-21swapper/022:24:230
278355999179,4cyclictest3025303-21runrttasks22:08:530
278355999179,4cyclictest0-21swapper/021:49:360
278355999176,5cyclictest0-21swapper/021:44:230
278355999175,4cyclictest0-21swapper/023:54:250
2783559991714,2cyclictest3119667-21grep23:00:000
2783559991714,2cyclictest3075428-21cat22:35:010
2783559991714,2cyclictest2964194-21cpuspeed_turbos21:34:270
2783559991714,2cyclictest2828208-21systemd-run19:45:000
278355999170,2cyclictest3156463-21chrt23:21:580
2555591170,2phc2sys0-21swapper/322:27:283
2555591170,2phc2sys0-21swapper/321:58:313
2783561991614,1cyclictest0-21swapper/220:14:242
2783561991614,1cyclictest0-21swapper/200:40:002
2783561991613,1cyclictest0-21swapper/222:59:342
2783561991613,1cyclictest0-21swapper/220:09:272
2783561991612,2cyclictest0-21swapper/222:00:002
278356099169,2cyclictest2960390-21timerandwakeup21:29:381
278356099161,5cyclictest2021-21snmpd00:21:161
2783560991613,2cyclictest0-21swapper/120:20:011
2783560991612,3cyclictest2952204-21kworker/u16:1+nfsiod22:39:441
2783560991612,2cyclictest2907789-21systemd-run20:55:011
278355999168,2cyclictest0-21swapper/000:29:260
278355999168,2cyclictest0-21swapper/000:24:560
278355999161,9cyclictest3242914-21systemd-run00:10:020
2783559991614,1cyclictest2934752-21ssh21:15:020
2783559991613,2cyclictest3225405-21systemd-run00:00:030
2783559991613,2cyclictest2841720-21irqcore19:59:300
2783559991613,2cyclictest2789816-21timerandwakeup19:15:010
2783559991613,2cyclictest1625-21avahi-daemon22:50:020
2783559991613,2cyclictest1625-21avahi-daemon20:55:010
2783559991613,2cyclictest0-21swapper/020:10:010
2783559991613,2cyclictest0-21swapper/000:20:010
2783559991613,2cyclictest0-21swapper/000:20:010
2783559991612,3cyclictest3278095-21kworker/u16:0+nfsiod00:36:400
2783559991612,3cyclictest2952204-21kworker/u16:1+nfsiod22:14:260
2783559991612,3cyclictest2907917-21kworker/u16:2+nfsiod21:51:000
278355999160,11cyclictest2834157-21grep19:50:000
2555591160,2phc2sys0-21swapper/323:45:003
2555591160,2phc2sys0-21swapper/321:14:343
27942132151,5sleep02795968-21cut19:19:330
278356199155,2cyclictest0-21swapper/223:41:332
2783561991513,1cyclictest0-21swapper/223:24:272
2783561991512,1cyclictest0-21swapper/223:50:022
2783561991512,1cyclictest0-21swapper/221:39:272
2783561991512,1cyclictest0-21swapper/221:19:382
2783561991512,1cyclictest0-21swapper/220:39:392
2783561991512,1cyclictest0-21swapper/220:04:332
2783561991512,1cyclictest0-21swapper/219:59:262
2783561991512,1cyclictest0-21swapper/200:29:332
2783561991511,2cyclictest0-21swapper/219:24:322
2783561991510,3cyclictest0-21swapper/200:09:322
278356199150,13cyclictest0-21swapper/223:05:082
278356199150,13cyclictest0-21swapper/221:49:312
278355999159,2cyclictest2925718-21diskmemload23:07:410
278355999155,4cyclictest3279416-21sshd00:31:560
2783559991512,2cyclictest3202530-21gltestperf23:49:270
2783559991512,2cyclictest3013536-21latency_hist22:00:000
2783559991512,2cyclictest2882923-21systemd-run20:30:020
2783559991511,3cyclictest2918881-21latency21:04:320
2555591150,3phc2sys0-21swapper/323:09:393
2783561991412,1cyclictest0-21swapper/223:19:332
2783561991412,1cyclictest0-21swapper/222:24:272
2783561991411,2cyclictest0-21swapper/223:51:562
2783561991411,1cyclictest0-21swapper/222:14:312
2783561991411,1cyclictest0-21swapper/221:54:552
2783561991411,1cyclictest0-21swapper/221:35:002
2783561991411,1cyclictest0-21swapper/221:29:142
2783561991411,1cyclictest0-21swapper/221:09:372
2783561991411,1cyclictest0-21swapper/221:04:312
2783561991411,1cyclictest0-21swapper/220:25:012
2783561991411,1cyclictest0-21swapper/219:54:322
278356099145,4cyclictest2004-21runrttasks00:05:271
2783560991411,2cyclictest2805185-21fschecks_time19:29:271
2783560991410,3cyclictest2889704-21cpuspeed_turbos20:39:271
2783560991410,3cyclictest2849641-21kthreadcore20:04:331
278355999144,4cyclictest2865024-21sshd20:16:550
2783559991411,2cyclictest3123330-21cut23:04:270
2783559991411,2cyclictest2924773-21kthreadcore21:09:330
2783559991411,2cyclictest2908871-21cut20:59:220
2783559991411,2cyclictest2892008-21kthreadcore20:39:330
2783559991411,2cyclictest2819426-21kthreadcore19:39:330
2783559991410,3cyclictest3031423-21kworker/u16:2+nfsiod23:15:390
2555591140,2phc2sys0-21swapper/323:31:203
2555591140,2phc2sys0-21swapper/322:23:433
2555591140,2phc2sys0-21swapper/322:17:183
2555591140,2phc2sys0-21swapper/300:36:073
2555591140,2phc2sys0-21swapper/300:09:563
2555591140,1phc2sys0-21swapper/300:26:473
278356199139,2cyclictest0-21swapper/219:19:332
278356199134,2cyclictest0-21swapper/219:41:512
278356199133,2cyclictest0-21swapper/222:46:462
278356199132,1cyclictest0-21swapper/222:08:342
2783561991311,1cyclictest0-21swapper/220:45:002
2783561991311,1cyclictest0-21swapper/200:14:282
2783561991310,2cyclictest0-21swapper/221:44:322
2783561991310,1cyclictest0-21swapper/222:39:252
2783561991310,1cyclictest0-21swapper/220:49:292
278356099136,2cyclictest176650irq/121-eno120:44:271
2783560991310,2cyclictest2878360-21irqcore20:29:291
2783559991310,2cyclictest2883530-21aten_repower_vo20:34:290
2555591131,3phc2sys0-21swapper/319:09:233
2555591130,3phc2sys0-21swapper/323:59:493
2555591130,3phc2sys0-21swapper/322:04:493
2555591130,1phc2sys0-21swapper/320:13:343
30688852121,2sleep30-21swapper/322:33:093
2783561991210,1cyclictest0-21swapper/220:59:262
2783561991210,1cyclictest0-21swapper/220:29:312
278355999129,2cyclictest2799276-21idleruntime19:24:280
278355999129,2cyclictest2783682-21latency_hist19:10:010
278355999122,5cyclictest0-21swapper/020:24:240
2555591122,2phc2sys0-21swapper/321:28:293
2555591121,2phc2sys0-21swapper/322:40:103
2555591120,2phc2sys0-21swapper/323:49:123
2555591120,2phc2sys0-21swapper/323:35:293
32338802110,2sleep30-21swapper/300:04:553
32099992110,2sleep30-21swapper/323:53:283
28755532112,2sleep30-21swapper/320:24:323
278356199119,1cyclictest0-21swapper/219:46:192
278356199111,1cyclictest0-21swapper/219:10:002
278356099114,5cyclictest1633-21dbus-daemon19:10:011
2555591112,2phc2sys0-21swapper/322:39:103
2555591112,2phc2sys0-21swapper/321:44:323
2555591111,7phc2sys2895232-21chrt20:41:303
2555591111,3phc2sys0-21swapper/321:20:523
2555591111,3phc2sys0-21swapper/321:20:523
2555591111,2phc2sys0-21swapper/319:29:313
2555591111,2phc2sys0-21swapper/300:16:143
2555591111,2phc2sys0-21swapper/300:16:143
2555591110,3phc2sys0-21swapper/321:45:523
2555591110,3phc2sys0-21swapper/320:19:283
2555591110,3phc2sys0-21swapper/319:49:223
2555591110,2phc2sys0-21swapper/320:39:273
2555591110,2phc2sys0-21swapper/320:31:583
2555591110,2phc2sys0-21swapper/320:04:253
2555591110,2phc2sys0-21swapper/319:40:333
2555591110,2phc2sys0-21swapper/319:34:243
2555591110,2phc2sys0-21swapper/300:14:593
2555591110,1phc2sys0-21swapper/319:50:423
31383692100,3sleep30-21swapper/323:11:323
31383692100,3sleep30-21swapper/323:11:323
2555591103,3phc2sys0-21swapper/321:35:413
2555591102,3phc2sys0-21swapper/319:15:013
2555591101,2phc2sys0-21swapper/323:19:343
2555591101,2phc2sys0-21swapper/323:04:233
2555591101,2phc2sys0-21swapper/319:19:293
2555591100,3phc2sys0-21swapper/300:30:033
2555591100,2phc2sys0-21swapper/323:25:153
2555591100,2phc2sys0-21swapper/323:21:023
2555591100,2phc2sys0-21swapper/320:59:243
2555591100,2phc2sys0-21swapper/320:49:253
2555591100,2phc2sys0-21swapper/300:23:113
2555591100,1phc2sys0-21swapper/322:59:413
255559193,3phc2sys0-21swapper/319:24:133
255559191,2phc2sys0-21swapper/322:10:053
255559191,2phc2sys0-21swapper/321:15:193
255559190,2phc2sys0-21swapper/320:52:323
255559190,2phc2sys0-21swapper/320:29:253
255559190,2phc2sys0-21swapper/319:59:243
255559190,2phc2sys0-21swapper/319:39:283
255559181,2phc2sys0-21swapper/320:06:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional