You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 22:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot6.osadl.org (updated Sat Nov 22, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1773911100,3ptp4l401ktimersoftd/308:12:553
14747997060,5cyclictest33-21ksoftirqd/210:47:482
144022644,9sleep00-21swapper/008:14:290
1474199630,3cyclictest22462-21seq11:14:311
14747996248,7cyclictest33-21ksoftirqd/212:47:502
106862610,2sleep00-21swapper/010:19:190
1320625935,9sleep10-21swapper/108:12:521
221072570,5sleep222106-21expr13:12:532
151982560,2sleep10-21swapper/110:25:181
14747995646,5cyclictest33-21ksoftirqd/212:52:562
286102550,2sleep00-21swapper/009:52:330
14747995545,5cyclictest33-21ksoftirqd/209:37:452
14747995443,5cyclictest33-21ksoftirqd/209:32:472
50032520,2sleep10-21swapper/110:53:001
14747995142,4cyclictest33-21ksoftirqd/209:27:462
1475499506,7cyclictest24288-21tr11:17:503
1475499506,7cyclictest21917-21fschecks_count09:37:493
14747995040,5cyclictest33-21ksoftirqd/213:37:542
1475499494,7cyclictest12813-21irqrtprio09:17:523
1475499485,7cyclictest4278-21grep10:52:553
14747994838,5cyclictest33-21ksoftirqd/211:37:532
14747994838,5cyclictest33-21ksoftirqd/211:37:532
14747994837,5cyclictest33-21ksoftirqd/213:17:522
1475499474,8cyclictest748-21awk10:02:333
1475499474,6cyclictest4795-21cut11:32:533
1475499474,6cyclictest3526-21latency_hist10:52:353
1475499472,8cyclictest12744-21cstates10:22:503
14747994741,3cyclictest33-21ksoftirqd/213:32:422
14747994741,3cyclictest33-21ksoftirqd/213:32:422
1475499464,6cyclictest401ktimersoftd/309:32:473
1475499463,8cyclictest28521-21cat11:22:513
1475499463,7cyclictest28051-21awk09:48:033
1475499462,6cyclictest401ktimersoftd/313:17:533
1475499458,5cyclictest41-21ksoftirqd/310:37:563
1475499454,8cyclictest401ktimersoftd/311:02:353
1475499453,8cyclictest401ktimersoftd/310:33:073
1475499443,7cyclictest20242-21cstates11:12:503
14754994417,4cyclictest41-21ksoftirqd/312:44:383
14747994436,4cyclictest33-21ksoftirqd/212:57:512
1475499433,8cyclictest28115-21if_err_enp1s008:42:503
1475499433,7cyclictest16488-21hddtemp_smartct11:07:533
1475499430,5cyclictest0-21swapper/309:27:323
14747994336,4cyclictest33-21ksoftirqd/213:22:412
14747994323,5cyclictest33-21ksoftirqd/211:32:572
14737994322,14cyclictest1760-21runrttasks10:22:490
290622420,2sleep00-21swapper/009:52:490
290622420,2sleep00-21swapper/009:52:490
1475499426,5cyclictest41-21ksoftirqd/313:25:583
1475499423,6cyclictest401ktimersoftd/312:38:073
177391410,1ptp4l401ktimersoftd/312:18:053
1475499413,7cyclictest4383-21sed10:07:553
14754994137,2cyclictest391rcuc/313:01:333
1474199412,34cyclictest0-21swapper/112:22:511
177391400,1ptp4l401ktimersoftd/311:53:043
1475499406,5cyclictest41-21ksoftirqd/312:56:533
1475499405,6cyclictest41-21ksoftirqd/312:51:203
14747994035,3cyclictest33-21ksoftirqd/213:32:382
14747994035,3cyclictest33-21ksoftirqd/213:32:382
14747994029,6cyclictest33-21ksoftirqd/211:22:502
1475499396,5cyclictest41-21ksoftirqd/311:29:473
1475499395,6cyclictest41-21ksoftirqd/313:43:433
1475499393,5cyclictest41-21ksoftirqd/310:32:333
1475499392,6cyclictest401ktimersoftd/309:53:133
1475499392,6cyclictest401ktimersoftd/309:53:133
14747993927,10cyclictest33-21ksoftirqd/210:28:042
139382394,21sleep212512-21/usr/sbin/munin08:13:022
177391380,1ptp4l401ktimersoftd/313:29:393
177391380,1ptp4l401ktimersoftd/313:29:393
177391380,1ptp4l401ktimersoftd/313:13:083
177391380,1ptp4l401ktimersoftd/313:08:583
177391380,1ptp4l401ktimersoftd/312:15:263
177391380,1ptp4l401ktimersoftd/312:07:373
177391380,1ptp4l401ktimersoftd/311:44:533
177391380,1ptp4l401ktimersoftd/311:44:533
177391380,0ptp4l401ktimersoftd/312:24:433
177391380,0ptp4l401ktimersoftd/310:43:333
1475499387,5cyclictest41-21ksoftirqd/311:07:083
1475499386,9cyclictest41-21ksoftirqd/309:04:123
1475499384,5cyclictest41-21ksoftirqd/312:33:573
1475499384,5cyclictest41-21ksoftirqd/311:50:493
1475499382,4cyclictest0-21swapper/312:04:123
14754993816,9cyclictest41-21ksoftirqd/313:42:383
1474799384,4cyclictest121rcu_preempt11:57:502
14747993833,3cyclictest33-21ksoftirqd/212:32:492
14747993832,3cyclictest33-21ksoftirqd/211:02:532
14747993831,4cyclictest33-21ksoftirqd/210:07:342
1474199380,5cyclictest27559-21ssh10:42:021
1474199380,5cyclictest15196-21grep13:03:021
1474199380,4cyclictest24145-21ssh13:14:141
1474199380,4cyclictest20839-21grep08:27:511
1474199380,3cyclictest15599-21ssh11:45:521
1474199380,3cyclictest15599-21ssh11:45:521
177391370,1ptp4l401ktimersoftd/313:35:213
177391370,1ptp4l401ktimersoftd/313:35:213
177391370,1ptp4l401ktimersoftd/313:02:523
177391370,1ptp4l401ktimersoftd/309:42:523
1475499374,5cyclictest41-21ksoftirqd/312:00:303
14747993732,3cyclictest33-21ksoftirqd/213:43:082
14747993732,3cyclictest33-21ksoftirqd/210:47:342
14747993731,3cyclictest33-21ksoftirqd/213:07:372
14747993731,3cyclictest33-21ksoftirqd/211:22:352
14747993731,3cyclictest33-21ksoftirqd/209:47:332
14747993725,9cyclictest33-21ksoftirqd/211:47:552
1474199373,31cyclictest24587-21head11:17:531
1474199370,4cyclictest29166-21sed12:02:361
1474199370,3cyclictest31284-21ssh12:03:161
1475499362,5cyclictest401ktimersoftd/311:37:513
1475499362,5cyclictest401ktimersoftd/311:37:513
1475499360,7cyclictest401ktimersoftd/308:37:533
14747993631,3cyclictest33-21ksoftirqd/211:28:072
14747993631,3cyclictest33-21ksoftirqd/210:27:342
14747993631,3cyclictest33-21ksoftirqd/209:57:502
14747993631,3cyclictest33-21ksoftirqd/209:47:512
14747993630,3cyclictest33-21ksoftirqd/212:43:082
14747993630,3cyclictest33-21ksoftirqd/211:52:512
14747993630,3cyclictest33-21ksoftirqd/210:57:532
14747993630,3cyclictest33-21ksoftirqd/210:17:342
1474199362,5cyclictest15982-21apt-get11:07:481
1474199362,28cyclictest0-21swapper/113:07:491
14741993613,20cyclictest7875-21latency_hist10:17:341
14741993610,23cyclictest427-21sed10:47:541
1474199360,5cyclictest15299-21ssh13:41:431
1474199360,4cyclictest7086-21idleruntime-cro09:07:321
1474199360,4cyclictest19376-21ssh10:30:221
1474199360,4cyclictest11095-21cron11:02:351
14754993515,8cyclictest41-21ksoftirqd/312:28:073
1474799359,4cyclictest33-21ksoftirqd/209:53:042
1474799359,4cyclictest33-21ksoftirqd/209:53:042
1474799358,4cyclictest33-21ksoftirqd/208:17:492
14747993530,3cyclictest33-21ksoftirqd/210:42:342
14747993530,3cyclictest33-21ksoftirqd/209:17:322
14747993529,4cyclictest33-21ksoftirqd/212:22:362
14747993529,3cyclictest33-21ksoftirqd/212:27:372
14747993529,3cyclictest33-21ksoftirqd/212:03:072
14747993529,3cyclictest33-21ksoftirqd/211:42:512
14747993529,3cyclictest33-21ksoftirqd/211:42:512
14747993529,3cyclictest33-21ksoftirqd/209:23:022
14747993522,10cyclictest33-21ksoftirqd/213:07:542
1474199351,3cyclictest2547-21ssh11:30:101
14741993511,21cyclictest9099-21sed11:38:001
14741993511,21cyclictest9099-21sed11:38:001
1474199350,4cyclictest29625-21latency_hist08:47:321
1474199350,4cyclictest22731-21acpi08:32:431
1474199350,4cyclictest1118-21apt-get12:07:481
1474199350,3cyclictest6973-21cut13:32:381
1474199350,3cyclictest6973-21cut13:32:381
14747993429,3cyclictest33-21ksoftirqd/212:12:362
14747993429,3cyclictest33-21ksoftirqd/210:12:342
14747993428,3cyclictest33-21ksoftirqd/211:12:522
14747993428,3cyclictest33-21ksoftirqd/208:28:062
14747993419,4cyclictest33-21ksoftirqd/212:37:542
1474199348,23cyclictest20191-21sendmail13:47:381
1474199342,4cyclictest0-21swapper/111:47:481
1474199342,3cyclictest0-21swapper/111:52:511
1474199341,6cyclictest0-21swapper/112:37:501
14741993413,18cyclictest17122-21ls09:27:481
14741993410,20cyclictest11524-21cpu11:02:501
1474199340,32cyclictest0-21swapper/109:23:021
1475499332,22cyclictest0-21swapper/310:02:453
14754993312,8cyclictest41-21ksoftirqd/310:14:463
1474799337,7cyclictest33-21ksoftirqd/210:17:552
14747993328,3cyclictest33-21ksoftirqd/212:13:062
14747993328,3cyclictest33-21ksoftirqd/209:02:322
14747993328,3cyclictest33-21ksoftirqd/208:57:322
14747993328,3cyclictest33-21ksoftirqd/208:37:442
14747993327,3cyclictest33-21ksoftirqd/212:27:562
14747993327,3cyclictest33-21ksoftirqd/211:07:582
14747993327,3cyclictest33-21ksoftirqd/210:53:122
14747993327,3cyclictest33-21ksoftirqd/208:37:312
14747993327,3cyclictest33-21ksoftirqd/208:27:312
14747993322,8cyclictest33-21ksoftirqd/210:32:462
1474199338,22cyclictest8106-21cut09:07:511
1474199338,22cyclictest3196-21latency_hist10:07:331
1474199337,22cyclictest5273-21cpu12:12:511
14741993314,16cyclictest30795-21sh10:44:591
1474199331,29cyclictest461-21rm12:46:091
14741993310,20cyclictest19031-21grep12:28:071
14741993310,20cyclictest1797-21sh13:26:561
14741993310,19cyclictest13059-21sed12:22:371
1474199330,4cyclictest30165-21rm11:23:091
1474199330,4cyclictest25255-21munin-run12:37:371
1474199330,4cyclictest12905-21ssh13:01:301
1474199330,4cyclictest11704-21ssh10:21:301
1474199330,3cyclictest3819-21cat08:58:041
1474199330,3cyclictest1420-21ssh12:47:411
1474199330,3cyclictest10821-21ssh13:36:301
1474199330,3cyclictest10821-21ssh13:36:301
177391320,1ptp4l401ktimersoftd/310:17:513
1475499325,6cyclictest18036-21grep08:22:453
14747993227,3cyclictest33-21ksoftirqd/208:47:332
14747993226,3cyclictest33-21ksoftirqd/208:42:492
1474199329,20cyclictest1760-21runrttasks08:19:031
1474199327,22cyclictest22414-21irqrtprio09:37:521
1474199323,7cyclictest9769-21apt-get09:12:461
14741993212,17cyclictest30064-21mailstats09:52:571
14741993212,17cyclictest30064-21mailstats09:52:571
14741993210,19cyclictest32067-21cat09:57:531
1474199320,4cyclictest12391-21diskstats09:17:481
1474199320,3cyclictest22649-21sh10:33:461
1474199320,29cyclictest8719-21rm12:56:131
1474199320,28cyclictest25807-21/usr/sbin/munin13:18:001
14754993111,8cyclictest41-21ksoftirqd/308:21:383
14747993126,3cyclictest33-21ksoftirqd/209:03:012
14747993125,3cyclictest33-21ksoftirqd/209:12:332
1474199318,19cyclictest5136-21awk10:08:051
1474199317,21cyclictest27260-21kernelversion09:47:531
1474199311,4cyclictest0-21swapper/108:22:441
1474199311,3cyclictest0-21swapper/108:47:451
1474199310,3cyclictest4058-21cpuspeed_turbos11:32:481
1475499305,9cyclictest41-21ksoftirqd/308:32:533
14754993012,6cyclictest41-21ksoftirqd/308:57:553
1474199301,5cyclictest1401-21snmp_o5powerctl08:53:011
14737993023,4cyclictest9-21ksoftirqd/010:02:330
1475499293,7cyclictest0-21swapper/309:29:053
14754992924,3cyclictest41-21ksoftirqd/309:07:483
14754992912,7cyclictest41-21ksoftirqd/308:47:513
14747992924,3cyclictest33-21ksoftirqd/209:22:322
1474199294,4cyclictest24269-21fschecks_count09:42:511
1474199293,5cyclictest19943-21irqrtprio09:32:521
1474199290,6cyclictest26212-21sed08:37:521
9782280,4sleep0101ktimersoftd/008:52:560
14754992824,2cyclictest391rcuc/308:28:273
1475499280,5cyclictest0-21swapper/308:53:033
14737992822,3cyclictest9-21ksoftirqd/009:30:320
14737992822,3cyclictest9-21ksoftirqd/008:35:040
14754992723,2cyclictest391rcuc/309:12:583
14737992722,3cyclictest9-21ksoftirqd/011:39:000
14737992722,3cyclictest9-21ksoftirqd/011:39:000
14737992721,4cyclictest9-21ksoftirqd/012:56:210
14737992721,3cyclictest9-21ksoftirqd/012:03:320
14737992621,3cyclictest9-21ksoftirqd/011:07:350
14737992620,3cyclictest9-21ksoftirqd/013:33:420
14737992620,3cyclictest9-21ksoftirqd/013:33:420
14737992620,3cyclictest9-21ksoftirqd/009:24:420
14737992619,4cyclictest9-21ksoftirqd/010:12:200
14737992619,4cyclictest9-21ksoftirqd/009:35:430
14737992520,3cyclictest9-21ksoftirqd/013:27:380
14737992519,4cyclictest9-21ksoftirqd/009:16:240
14737992519,3cyclictest9-21ksoftirqd/013:11:570
14737992519,3cyclictest9-21ksoftirqd/008:44:170
14737992519,3cyclictest9-21ksoftirqd/008:41:390
14737992519,3cyclictest9-21ksoftirqd/008:26:260
14737992518,4cyclictest9-21ksoftirqd/010:53:310
14737992518,4cyclictest9-21ksoftirqd/010:03:330
1670122417,3sleep09-21ksoftirqd/012:26:510
14737992419,3cyclictest9-21ksoftirqd/013:16:440
14737992419,3cyclictest9-21ksoftirqd/013:07:370
14737992419,3cyclictest9-21ksoftirqd/012:08:050
14737992418,4cyclictest9-21ksoftirqd/008:51:030
14737992418,3cyclictest9-21ksoftirqd/011:21:240
14737992418,3cyclictest9-21ksoftirqd/010:48:500
14737992417,4cyclictest9-21ksoftirqd/011:26:150
14737992417,4cyclictest9-21ksoftirqd/008:17:440
14737992316,4cyclictest9-21ksoftirqd/013:31:410
14737992316,4cyclictest9-21ksoftirqd/013:31:410
14737992316,4cyclictest9-21ksoftirqd/009:08:130
1473799223,16cyclictest12459-21grep09:17:490
1473799223,11cyclictest7473-21ssh10:57:500
1473799222,12cyclictest21414-21ssh12:32:510
14737992217,3cyclictest9-21ksoftirqd/012:48:260
14737992216,3cyclictest9-21ksoftirqd/011:13:570
14737992116,3cyclictest9-21ksoftirqd/010:46:050
14737992116,3cyclictest9-21ksoftirqd/008:28:470
14737992115,3cyclictest9-21ksoftirqd/012:27:480
14737992115,3cyclictest9-21ksoftirqd/009:46:270
14737992114,4cyclictest9-21ksoftirqd/010:38:180
14737992114,4cyclictest9-21ksoftirqd/009:39:400
14737992114,4cyclictest16547-21tune2fs13:42:560
14737992114,4cyclictest11428-21unixbench-2d12:58:110
14737992112,7cyclictest10950-21unixbench_singl12:18:070
1473799208,7cyclictest101ktimersoftd/011:07:480
14737992014,4cyclictest9-21ksoftirqd/012:38:540
14737992014,3cyclictest9-21ksoftirqd/009:05:000
14737992014,3cyclictest29906-21cpuspeed_turbos12:42:510
14737992013,4cyclictest7876-21diskmemload11:48:520
14737992013,4cyclictest12387-21/usr/sbin/munin11:43:010
14737992013,4cyclictest12387-21/usr/sbin/munin11:43:010
1473799191,3cyclictest0-21swapper/013:19:240
14737991913,3cyclictest9-21ksoftirqd/008:57:570
14737991913,3cyclictest8898-21sed12:17:370
14737991913,3cyclictest17552-21missed_timers10:27:540
14737991912,4cyclictest4177-21expr11:32:480
14737991912,4cyclictest26114-21cut11:57:560
1473799191,16cyclictest0-21swapper/011:55:200
1473799191,16cyclictest0-21swapper/011:32:030
1473799191,16cyclictest0-21swapper/010:35:280
1473799190,17cyclictest0-21swapper/010:14:490
1473799180,16cyclictest0-21swapper/013:38:540
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional