You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-06 - 14:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot2.osadl.org (updated Thu Nov 06, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
345010721020,3sleep00-21swapper/022:55:020
345010721020,3sleep00-21swapper/022:55:020
335325321000,2sleep30-21swapper/321:59:193
34071272560,1sleep10-21swapper/122:30:471
35455762290,1sleep10-21swapper/123:50:421
35625752230,2sleep13562581-21cron00:00:001
311782499230,17cyclictest3449583-21latency_hist22:55:011
311782499230,17cyclictest3449583-21latency_hist22:55:011
3117822992312,7cyclictest3316294-21mailstats21:35:590
311782499229,5cyclictest0-21swapper/100:18:351
3117824992219,2cyclictest3284378-21cron21:20:001
3117824992216,2cyclictest170550irq/121-eno123:05:571
311782499221,12cyclictest3181761-21apt-get20:00:491
3117824992210,6cyclictest3572932-1hddtemp_smartct00:05:511
311782499220,4cyclictest3614957-21munin-run00:30:011
3117828992119,1cyclictest0-21swapper/220:15:012
3117828992119,1cyclictest0-21swapper/219:40:022
3117824992118,2cyclictest3527541-21latency_hist23:40:011
3117824992115,2cyclictest191rcu_preempt21:05:591
3117824992114,3cyclictest36-21ksoftirqd/123:45:561
3117824992110,6cyclictest36-21ksoftirqd/120:15:011
311782299218,7cyclictest0-21swapper/022:45:560
3117828992017,1cyclictest0-21swapper/223:55:012
3117828992017,1cyclictest0-21swapper/222:20:012
311782499209,2cyclictest0-21swapper/123:25:591
311782499203,5cyclictest3131278-21cat19:15:571
311782499203,11cyclictest3142659-21cut19:25:561
3117824992017,2cyclictest3406419-21/usr/sbin/munin22:30:001
3117824992017,2cyclictest3212250-21wc20:25:001
3117824992016,3cyclictest3581218-21cstates00:10:511
3117824992016,3cyclictest3388920-21apt-key22:20:011
3117824992014,2cyclictest36-21ksoftirqd/121:30:011
3117824992014,2cyclictest191rcu_preempt20:30:501
3117824992013,2cyclictest191rcu_preempt22:02:341
3117824992012,3cyclictest3306931-21kthreadcore21:30:551
311782499201,13cyclictest3624221-21apt-get00:35:481
3117824992011,2cyclictest191rcu_preempt21:55:561
311782499200,4cyclictest36-21ksoftirqd/122:40:521
3117822992017,2cyclictest3458991-21latency_hist23:00:020
311782299200,19cyclictest3629311-21ssh00:35:590
33624002190,1sleep30-21swapper/322:05:013
3117828991917,1cyclictest0-21swapper/200:00:012
311782499199,6cyclictest36-21ksoftirqd/120:50:011
311782499199,6cyclictest0-21swapper/122:24:371
311782499199,6cyclictest0-21swapper/122:24:371
311782499199,4cyclictest3564373-21sed00:00:531
311782499198,2cyclictest0-21swapper/122:10:221
311782499196,2cyclictest0-21swapper/119:35:531
311782499194,10cyclictest3134495-21kthreadcore19:20:531
311782499193,7cyclictest0-21swapper/123:15:471
311782499193,6cyclictest3419687-21kthreadcore22:35:561
311782499193,6cyclictest0-21swapper/121:23:371
311782499193,10cyclictest3315633-21kthreadcore21:35:561
311782499193,10cyclictest3119428-21kthreadcore19:10:541
311782499192,11cyclictest3256150-21sed21:00:541
3117824991916,2cyclictest3193987-21latency_hist20:10:021
3117824991913,2cyclictest191rcu_preempt20:40:571
3117824991912,3cyclictest36-21ksoftirqd/100:30:501
3117824991912,3cyclictest3460044-21cstates23:00:501
3117824991911,3cyclictest3149665-21latency19:30:551
3117824991911,2cyclictest3341199-21kthreadcore21:50:551
3117824991910,5cyclictest36-21ksoftirqd/122:05:541
3117824991910,3cyclictest3482889-21sh23:11:461
311782299198,6cyclictest0-21swapper/023:00:540
3117822991917,1cyclictest3415088-21/usr/sbin/munin22:35:010
3117822991916,2cyclictest1635-21dbus-daemon19:25:020
3117822991910,5cyclictest3609551-21kthreadcore00:25:560
302487291190,2phc2sys0-21swapper/323:33:273
311782899183,5cyclictest0-21swapper/200:10:012
311782899181,9cyclictest0-21swapper/223:20:002
3117828991815,1cyclictest0-21swapper/222:10:562
3117828991815,1cyclictest0-21swapper/220:10:012
3117828991815,1cyclictest0-21swapper/200:15:532
311782499188,2cyclictest0-21swapper/120:50:551
311782499188,2cyclictest0-21swapper/100:20:581
311782499187,6cyclictest0-21swapper/121:45:541
311782499187,6cyclictest0-21swapper/120:35:561
311782499186,2cyclictest0-21swapper/120:15:531
311782499186,2cyclictest0-21swapper/120:15:531
311782499184,3cyclictest3250165-21cut20:55:531
311782499183,9cyclictest3320974-21irqrtprio21:40:541
311782499183,6cyclictest3451935-21kthreadcore22:55:571
311782499182,10cyclictest3177371-21cut19:55:531
311782499181,5cyclictest36-21ksoftirqd/119:45:481
3117824991815,2cyclictest3434498-21sort22:45:581
3117824991813,1cyclictest191rcu_preempt21:10:511
3117824991811,2cyclictest3529658-21kthreadcore23:40:531
311782499180,6cyclictest3517006-21ssh23:31:001
311782299188,5cyclictest0-21swapper/021:25:500
311782299187,6cyclictest0-21swapper/022:00:470
3117822991815,2cyclictest3200196-21latency_hist20:15:010
3117822991815,2cyclictest3150725-21cron19:35:000
3117822991815,2cyclictest1635-21dbus-daemon22:10:010
3117822991815,2cyclictest0-21swapper/019:40:020
3117822991814,3cyclictest3580112-21systemd-run00:10:010
311782299181,15cyclictest3489879-21grep23:15:560
3117822991810,7cyclictest0-21swapper/023:45:500
3117822991810,4cyclictest3533673-21timerwakeupswit23:40:590
302487291180,3phc2sys0-21swapper/321:35:353
302487291180,2phc2sys0-21swapper/323:29:093
302487291180,2phc2sys0-21swapper/322:35:543
3117828991714,1cyclictest0-21swapper/223:10:012
311782499177,2cyclictest0-21swapper/119:40:521
311782499176,2cyclictest0-21swapper/123:20:531
311782499175,3cyclictest36-21ksoftirqd/119:50:521
3117824991713,3cyclictest3217627-21mailstats20:26:011
311782299179,4cyclictest3390167-21cstates22:20:470
311782299179,4cyclictest3390167-21cstates22:20:470
311782299178,4cyclictest0-21swapper/022:40:520
311782299178,2cyclictest0-21swapper/023:25:550
311782299178,2cyclictest0-21swapper/023:15:010
311782299178,2cyclictest0-21swapper/000:00:490
311782299177,5cyclictest0-21swapper/022:38:000
311782299177,5cyclictest0-21swapper/022:25:490
311782299177,5cyclictest0-21swapper/000:20:490
3117822991714,2cyclictest3266976-21systemd-run21:10:010
311782299171,3cyclictest3323747-21kthreadcore21:40:560
3117822991711,5cyclictest3277455-21irqcore21:15:550
302487291170,3phc2sys0-21swapper/300:32:493
302487291170,2phc2sys0-21swapper/323:40:553
3117828991613,1cyclictest0-21swapper/223:25:002
3117828991613,1cyclictest0-21swapper/223:14:432
3117828991613,1cyclictest0-21swapper/222:30:142
3117828991613,1cyclictest0-21swapper/222:10:012
3117828991613,1cyclictest0-21swapper/221:50:002
3117828991613,1cyclictest0-21swapper/221:41:002
3117828991613,1cyclictest0-21swapper/221:05:002
3117828991613,1cyclictest0-21swapper/220:41:012
3117828991613,1cyclictest0-21swapper/220:00:012
3117828991613,1cyclictest0-21swapper/200:20:572
3117824991613,2cyclictest1700-21systemd-logind19:10:021
311782299166,5cyclictest0-21swapper/023:55:580
311782299165,6cyclictest0-21swapper/021:55:500
311782299164,7cyclictest3161155-21cut19:40:530
3117822991613,2cyclictest3236712-21latency_hist20:45:010
3117822991613,2cyclictest1-21systemd21:50:010
3117822991612,3cyclictest3554446-21kworker/u16:3+nfsiod00:17:020
302487291160,3phc2sys0-21swapper/323:05:493
302487291160,2phc2sys0-21swapper/323:01:283
311782899152,6cyclictest0-21swapper/222:40:002
311782899151,6cyclictest0-21swapper/223:45:482
311782899151,3cyclictest0-21swapper/223:00:002
3117828991513,1cyclictest0-21swapper/222:00:552
3117828991513,1cyclictest0-21swapper/200:05:012
3117828991512,1cyclictest0-21swapper/223:36:022
3117828991512,1cyclictest0-21swapper/219:15:522
3117828991512,1cyclictest0-21swapper/200:30:472
311782299158,2cyclictest3303008-21df21:30:490
311782299157,7cyclictest0-21swapper/022:10:560
311782299151,9cyclictest3583308-21tr00:10:560
3117822991513,1cyclictest3175514-21cut19:55:020
3117822991513,1cyclictest0-21swapper/000:35:000
3117822991512,2cyclictest3499727-21unixbench_singl23:20:590
3117822991512,2cyclictest3254740-21wc21:00:000
3117822991512,2cyclictest3247839-21tr20:50:580
3117822991512,2cyclictest3211797-21unixbench-2d20:21:000
3117822991512,2cyclictest3169370-21latency_hist19:50:010
3117822991512,2cyclictest1702-21in:imuxsock21:11:040
3117822991512,2cyclictest0-21swapper/019:30:010
3117822991511,3cyclictest3527690-21kworker/u16:1+nfsiod23:51:260
3117822991510,4cyclictest0-21swapper/023:06:010
302487291150,4phc2sys0-21swapper/321:16:273
302487291150,2phc2sys0-21swapper/322:42:513
302487291150,2phc2sys0-21swapper/321:20:513
302487291150,2phc2sys0-21swapper/319:46:033
35808042140,3sleep30-21swapper/300:10:493
311782899149,3cyclictest0-21swapper/221:32:262
311782899141,6cyclictest0-21swapper/219:50:002
3117828991412,1cyclictest0-21swapper/222:55:022
3117828991412,1cyclictest0-21swapper/222:55:022
3117828991412,1cyclictest0-21swapper/221:55:012
3117828991412,1cyclictest0-21swapper/221:10:472
3117828991412,1cyclictest0-21swapper/221:10:022
3117828991411,1cyclictest0-21swapper/223:40:582
3117828991411,1cyclictest0-21swapper/221:35:192
3117828991411,1cyclictest0-21swapper/221:25:022
3117828991411,1cyclictest0-21swapper/200:10:542
3117828991410,2cyclictest0-21swapper/220:50:482
3117828991410,2cyclictest0-21swapper/200:39:062
311782899140,7cyclictest0-21swapper/220:45:472
311782299146,7cyclictest3239478-21tr20:45:540
311782299145,4cyclictest0-21swapper/021:50:540
311782299143,5cyclictest3381411-21df_inode22:15:520
311782299141,9cyclictest0-21swapper/020:35:380
311782299141,8cyclictest3511660-21/usr/sbin/munin23:30:500
3117822991411,2cyclictest3521058-21tr23:35:560
3117822991411,2cyclictest3219407-21gltestperf20:30:520
3117822991411,2cyclictest3117817-21cyclictest19:18:120
3117822991410,3cyclictest3286385-21irqrtprio21:20:530
302487291141,2phc2sys0-21swapper/322:52:423
302487291141,2phc2sys0-21swapper/322:52:423
302487291140,2phc2sys0-21swapper/322:25:143
302487291140,2phc2sys0-21swapper/321:06:043
302487291140,2phc2sys0-21swapper/320:50:063
302487291140,2phc2sys0-21swapper/300:09:503
835298130,3rtkit-daemon2025-21snmpd20:00:380
311782899139,2cyclictest0-21swapper/219:35:012
3117828991311,1cyclictest0-21swapper/221:57:282
3117828991311,1cyclictest0-21swapper/221:25:552
3117828991311,1cyclictest0-21swapper/200:28:112
3117828991310,1cyclictest0-21swapper/223:25:482
3117828991310,1cyclictest0-21swapper/223:04:312
3117828991310,1cyclictest0-21swapper/222:45:592
3117828991310,1cyclictest0-21swapper/222:40:532
3117828991310,1cyclictest0-21swapper/221:15:522
3117828991310,1cyclictest0-21swapper/220:35:502
3117828991310,1cyclictest0-21swapper/219:25:522
3117828991310,1cyclictest0-21swapper/219:10:552
311782899130,9cyclictest3254444-21taskset20:56:382
311782299133,5cyclictest3201121-21grep20:15:500
311782299133,5cyclictest3201121-21grep20:15:500
311782299132,6cyclictest3175727-21aten2.4-expect19:55:470
3117822991310,2cyclictest3213396-21idleruntime20:25:540
3117822991310,2cyclictest3188490-21fschecks_time20:05:510
3117822991310,2cyclictest3124891-21kthreadcore19:15:020
302487291133,3phc2sys0-21swapper/323:55:593
302487291131,4phc2sys0-21swapper/322:05:293
302487291130,4phc2sys0-21swapper/323:23:513
302487291130,3phc2sys0-21swapper/321:30:473
302487291130,3phc2sys0-21swapper/300:35:473
302487291130,2phc2sys0-21swapper/322:55:233
302487291130,2phc2sys0-21swapper/320:10:593
311782899129,1cyclictest0-21swapper/222:20:472
311782899129,1cyclictest0-21swapper/222:20:472
311782899128,2cyclictest0-21swapper/219:20:492
3117828991210,1cyclictest0-21swapper/223:30:532
3117828991210,1cyclictest0-21swapper/222:25:562
3117828991210,1cyclictest0-21swapper/220:25:522
3117828991210,1cyclictest0-21swapper/219:40:522
311782899120,4cyclictest0-21swapper/220:15:472
311782899120,4cyclictest0-21swapper/220:15:472
311782299125,5cyclictest1803-21gdbus19:10:020
311782299124,4cyclictest0-21swapper/021:00:530
302487291122,2phc2sys0-21swapper/321:50:553
302487291120,3phc2sys0-21swapper/319:40:023
302487291120,2phc2sys0-21swapper/323:53:553
311782899119,1cyclictest0-21swapper/220:00:522
311782899118,1cyclictest0-21swapper/220:30:122
311782899118,1cyclictest0-21swapper/220:20:462
311782899118,1cyclictest0-21swapper/219:50:572
302487291113,2phc2sys0-21swapper/300:17:233
302487291112,2phc2sys0-21swapper/300:02:163
302487291111,3phc2sys0-21swapper/320:25:543
302487291111,2phc2sys0-21swapper/322:47:573
302487291110,5phc2sys0-21swapper/321:45:413
302487291110,4phc2sys0-21swapper/323:45:483
302487291110,4phc2sys0-21swapper/320:15:553
302487291110,4phc2sys0-21swapper/320:15:553
302487291110,3phc2sys0-21swapper/323:36:473
302487291110,3phc2sys0-21swapper/323:14:183
302487291110,3phc2sys0-21swapper/322:33:353
302487291110,3phc2sys0-21swapper/321:25:383
302487291110,3phc2sys0-21swapper/319:15:013
302487291110,2phc2sys0-21swapper/320:40:503
302487291110,2phc2sys0-21swapper/319:37:483
302487291110,2phc2sys0-21swapper/319:17:503
302487291110,2phc2sys0-21swapper/300:30:013
302487291110,1phc2sys0-21swapper/321:03:303
302487291105,2phc2sys0-21swapper/320:40:023
302487291102,3phc2sys0-21swapper/322:20:113
302487291102,3phc2sys0-21swapper/322:20:113
302487291101,3phc2sys0-21swapper/321:10:473
302487291101,2phc2sys0-21swapper/320:00:533
302487291101,2phc2sys0-21swapper/319:06:003
302487291100,3phc2sys0-21swapper/322:19:083
302487291100,3phc2sys0-21swapper/322:12:593
302487291100,3phc2sys0-21swapper/319:20:543
302487291100,2phc2sys0-21swapper/323:15:423
302487291100,2phc2sys0-21swapper/319:33:533
302487291100,1phc2sys0-21swapper/320:57:133
31178289996,1cyclictest0-21swapper/219:10:012
30248729190,5phc2sys3237800-21chrt20:45:533
30248729190,2phc2sys0-21swapper/321:40:123
30248729190,2phc2sys0-21swapper/320:30:523
30248729190,2phc2sys0-21swapper/319:55:493
30248729190,2phc2sys0-21swapper/319:25:033
30248729190,2phc2sys0-21swapper/300:21:123
30248729180,2phc2sys0-21swapper/320:20:493
30248729180,2phc2sys0-21swapper/320:05:023
30248729180,2phc2sys0-21swapper/319:50:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional