You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-07 - 05:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot6.osadl.org (updated Mon Jul 07, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1742621660,5sleep11297999cyclictest01:27:451
2150721480,5sleep31299299cyclictest02:46:523
2150721480,5sleep31299299cyclictest02:46:523
1147421100,3sleep1241ktimersoftd/121:57:451
1518911000,4ptp4l401ktimersoftd/321:58:103
318672760,2sleep20-21swapper/201:07:422
151891670,1ptp4l401ktimersoftd/303:28:033
151891670,1ptp4l401ktimersoftd/301:57:353
43732620,3sleep125-21ksoftirqd/103:02:481
151891610,1ptp4l401ktimersoftd/323:07:413
316262600,4sleep231631-21gltestperf02:57:472
12975995946,7cyclictest9-21ksoftirqd/002:32:430
195902530,2sleep30-21swapper/302:07:423
4152520,1sleep10-21swapper/101:44:591
219602510,2sleep20-21swapper/200:56:062
12975995141,5cyclictest9-21ksoftirqd/002:47:440
151891500,2ptp4l6471-21kworker/3:002:16:173
1297999481,4cyclictest30122-21seq22:33:441
151891470,13ptp4l3449-21kworker/3:201:09:463
1299299472,38cyclictest0-21swapper/300:12:453
1297999471,4cyclictest26113-21taskset02:13:421
12975994735,7cyclictest9-21ksoftirqd/002:37:390
12975994437,3cyclictest9-21ksoftirqd/022:02:230
12975994434,4cyclictest9-21ksoftirqd/002:52:430
12975994331,5cyclictest9-21ksoftirqd/000:47:390
151891420,1ptp4l3449-21kworker/3:200:07:153
1299299413,10cyclictest40292irq/92-enp1s0-T00:42:403
1298699410,2cyclictest0-21swapper/222:10:402
1298699410,2cyclictest0-21swapper/200:25:032
1297999411,3cyclictest0-21swapper/103:18:491
12975994130,5cyclictest9-21ksoftirqd/000:57:390
12975994130,5cyclictest9-21ksoftirqd/000:57:390
1298699404,31cyclictest29026-21apt-get00:27:392
1298699402,30cyclictest7655-21apt-get03:07:432
1298699401,19cyclictest26941-21load22:27:442
1297999403,29cyclictest26882-21apt-get02:52:441
1297999400,5cyclictest16833-21tune2fs22:07:401
1297999390,5cyclictest13633-21grep22:02:401
1297999390,4cyclictest21688-21sed22:17:401
151891380,1ptp4l401ktimersoftd/323:25:513
151891380,1ptp4l401ktimersoftd/322:42:153
151891380,1ptp4l401ktimersoftd/322:07:513
151891380,1ptp4l401ktimersoftd/300:37:503
12979993812,23cyclictest13240-21/usr/sbin/munin02:37:451
12975993832,3cyclictest9-21ksoftirqd/000:07:300
12975993826,6cyclictest9-21ksoftirqd/022:47:370
151891370,1ptp4l401ktimersoftd/302:59:153
151891370,1ptp4l401ktimersoftd/302:20:113
151891370,1ptp4l401ktimersoftd/302:04:063
151891370,1ptp4l401ktimersoftd/300:08:353
12992993713,4cyclictest21480-21sh00:17:553
1299299370,16cyclictest11207-21sed23:02:463
1298699371,28cyclictest25736-21apt-get01:37:402
1298699370,35cyclictest0-21swapper/202:44:252
1298699370,35cyclictest0-21swapper/202:44:252
12979993712,22cyclictest28044-21idleruntime-cro22:32:241
12975993725,5cyclictest9-21ksoftirqd/023:07:360
1266523715,10sleep20-21swapper/221:59:412
151891360,1ptp4l401ktimersoftd/322:53:273
151891360,1ptp4l401ktimersoftd/322:29:303
151891360,1ptp4l401ktimersoftd/302:42:213
151891360,1ptp4l401ktimersoftd/301:43:003
151891360,1ptp4l401ktimersoftd/300:24:303
12992993612,4cyclictest5326-21cut02:27:463
12992993611,4cyclictest5902-21basename00:02:263
1298699362,26cyclictest17287-21apt-get23:17:372
1298699362,26cyclictest17287-21apt-get23:17:372
12986993615,18cyclictest4415-21/usr/sbin/munin02:27:412
1297999364,25cyclictest19598-21apt-get02:07:421
1297999362,5cyclictest0-21swapper/101:07:411
1297999362,4cyclictest0-21swapper/101:17:401
12979993612,20cyclictest3963-21sh00:35:111
12979993611,22cyclictest24686-21sort00:22:411
12975993631,3cyclictest9-21ksoftirqd/002:22:280
12975993626,5cyclictest9-21ksoftirqd/000:52:390
151891350,1ptp4l401ktimersoftd/323:33:383
151891350,1ptp4l401ktimersoftd/301:49:313
151891350,0ptp4l401ktimersoftd/303:09:563
12992993512,3cyclictest9318-21fschecks_time02:32:473
12992993510,5cyclictest22478-21expr02:47:463
1298699353,26cyclictest11070-21apt-get00:07:412
1298699352,25cyclictest29137-21apt-get23:42:392
1298699352,25cyclictest13239-21apt-get22:02:362
1297999359,22cyclictest14984-21irqrtprio00:47:461
1297999352,5cyclictest8911-21apt-get02:32:431
1297999352,28cyclictest0-21swapper/101:22:411
1297999351,6cyclictest0-21swapper/101:47:411
12979993514,18cyclictest23188-21expr00:57:411
12979993514,18cyclictest23188-21expr00:57:411
12979993513,19cyclictest12449-21mailstats00:07:521
12979993513,18cyclictest3616-21sh01:12:371
12979993512,20cyclictest19540-21expr03:22:461
12979993511,21cyclictest11788-21sh00:43:251
1297999350,4cyclictest7087-21unixbench-2d00:37:561
1297999350,4cyclictest11133-21missed_timers23:02:451
12975993525,5cyclictest9-21ksoftirqd/022:32:390
12992993414,3cyclictest26771-21apt-get23:37:393
12992993413,3cyclictest3554-21cat23:57:263
1298699344,24cyclictest26771-21apt-get23:37:402
1298699343,24cyclictest15254-21apt-get02:02:402
1298699343,22cyclictest18877-21apt-get22:12:362
1298699342,26cyclictest22974-21apt-get00:57:392
1298699342,26cyclictest22974-21apt-get00:57:392
1298699342,25cyclictest10153-21apt-get23:02:372
12986993414,17cyclictest22952-21timerandwakeup01:32:582
1298699341,30cyclictest9101-21cat01:17:492
1298699341,28cyclictest0-21swapper/201:42:392
1298699340,2cyclictest0-21swapper/200:42:482
1297999349,22cyclictest25797-21switchtime23:32:571
1297999349,21cyclictest20112-21gltestperf23:22:421
1297999342,5cyclictest0-21swapper/122:22:371
12979993413,18cyclictest24811-21sh01:36:241
1297999341,28cyclictest0-21swapper/100:02:411
12979993412,19cyclictest10817-21/usr/sbin/munin01:57:521
12979993411,20cyclictest28215-21sh02:17:381
12979993411,20cyclictest24345-21sh02:48:351
1297999340,4cyclictest7293-21ssh02:30:021
12975993428,3cyclictest9-21ksoftirqd/003:22:460
12975993423,6cyclictest9-21ksoftirqd/022:52:370
151891330,1ptp4l401ktimersoftd/303:18:123
1298699332,26cyclictest19300-21apt-get03:22:442
1298699332,25cyclictest5385-21apt-get00:37:382
1298699332,24cyclictest24000-21apt-get02:12:442
1298699332,24cyclictest20031-21apt-get00:17:412
1298699332,24cyclictest15729-21apt-get00:12:442
12986993315,15cyclictest25777-21cut22:27:242
12986993314,16cyclictest14125-21grep01:22:582
12986993313,17cyclictest2123-21irqrtprio23:52:482
12986993312,17cyclictest1036-21basename00:32:402
1298699330,2cyclictest0-21swapper/203:03:472
1297999339,21cyclictest2192-21cat22:42:531
1297999339,21cyclictest21006-21latency_hist22:17:231
1297999339,21cyclictest18811-21df00:52:421
1297999339,21cyclictest1505-21runrttasks03:16:321
1297999338,22cyclictest9300-21wc22:58:011
1297999338,22cyclictest17384-21timerwakeupswit00:13:011
1297999333,5cyclictest3033-21apt-get22:47:371
12979993312,18cyclictest4942-21phc2sys23:57:481
12979993310,20cyclictest5900-21diskmemload01:57:031
12979993310,20cyclictest31385-21irqrtprio22:37:421
12979993310,20cyclictest10537-21sh03:10:221
12979993310,19cyclictest1505-21runrttasks01:06:561
12975993327,4cyclictest9-21ksoftirqd/003:22:300
12975993321,10cyclictest9-21ksoftirqd/002:57:470
1298699322,24cyclictest27328-21apt-get01:02:392
1298699322,24cyclictest23091-21apt-get03:27:452
1298699322,24cyclictest22020-21apt-get23:27:392
1298699322,23cyclictest3831-21apt-get23:57:382
12986993214,15cyclictest7540-21wc22:57:242
12986993214,15cyclictest2393-21fschecks_count01:47:452
1298699321,24cyclictest644-21apt-get22:42:372
1298699321,24cyclictest15847-21apt-get03:17:462
12986993211,18cyclictest12608-21irqrtprio03:12:502
12986993210,18cyclictest12451-21cat23:07:362
1298699320,29cyclictest7894-21wc00:02:582
1297999329,20cyclictest19723-21sh02:43:151
1297999329,20cyclictest19723-21sh02:43:151
1297999325,23cyclictest0-21swapper/103:29:501
1297999324,25cyclictest0-21swapper/103:01:071
1297999323,6cyclictest12515-21apt-get23:07:361
1297999322,5cyclictest0-21swapper/123:12:371
1297999322,4cyclictest0-21swapper/123:47:391
1297999321,6cyclictest15530-21diskstats02:02:431
12975993227,3cyclictest9-21ksoftirqd/003:32:300
12975993227,3cyclictest9-21ksoftirqd/002:27:280
12975993226,3cyclictest9-21ksoftirqd/000:02:260
151891310,8ptp4l401ktimersoftd/301:03:383
151891310,1ptp4l401ktimersoftd/303:26:253
151891310,1ptp4l401ktimersoftd/300:34:283
1298699313,22cyclictest7796-21apt-get22:57:452
1298699312,23cyclictest10897-21apt-get01:57:452
12986993115,13cyclictest33-21ksoftirqd/223:16:052
1298699311,26cyclictest4482-21ssh01:12:472
12986993111,17cyclictest23378-21cat22:22:242
1298699310,2cyclictest0-21swapper/222:37:532
1298699310,2cyclictest0-21swapper/201:27:292
1297999316,6cyclictest0-21swapper/101:37:431
1297999315,3cyclictest18386-21open_inodes23:17:461
1297999315,3cyclictest18386-21open_inodes23:17:461
1297999312,7cyclictest32637-21apt-get02:22:421
1297999311,5cyclictest30741-21/usr/sbin/munin00:27:591
12979993111,17cyclictest6359-21latency22:52:451
12979993110,18cyclictest21966-21acpi23:27:381
1297999310,5cyclictest20762-21sed00:17:471
12975993125,4cyclictest1073-1kworker/u9:002:07:570
12975993125,3cyclictest9-21ksoftirqd/022:07:240
12975993125,3cyclictest9-21ksoftirqd/001:37:460
12975993122,7cyclictest9-21ksoftirqd/001:22:270
151891300,1ptp4l401ktimersoftd/302:52:343
12992993020,6cyclictest401ktimersoftd/303:12:433
1298699308,18cyclictest15571-21sh02:38:502
1298699302,22cyclictest6620-21apt-get01:52:442
1298699301,25cyclictest26406-21cat02:52:302
12986993012,15cyclictest28436-21cpuspeed_turbos22:32:402
1298699300,2cyclictest0-21swapper/223:26:462
1298699300,2cyclictest0-21swapper/202:18:062
1297999301,5cyclictest633-21dbus-daemon23:56:351
12975993025,3cyclictest9-21ksoftirqd/003:07:300
12975993025,3cyclictest9-21ksoftirqd/002:47:290
12975993025,3cyclictest9-21ksoftirqd/002:47:290
12975993025,3cyclictest9-21ksoftirqd/000:22:270
12975993024,4cyclictest9-21ksoftirqd/000:02:450
12975993024,3cyclictest9-21ksoftirqd/001:17:270
151891290,1ptp4l401ktimersoftd/323:42:523
1298699291,25cyclictest648-21grep02:22:472
1298699291,25cyclictest26253-21apt-get02:52:312
1298699291,25cyclictest19520-21/usr/sbin/munin02:07:502
1298699291,25cyclictest16330-21ssh00:48:452
1298699291,21cyclictest24408-21apt-get23:32:422
12986992911,15cyclictest3102-21cat22:47:392
1298699290,2cyclictest0-21swapper/202:36:102
1297999291,6cyclictest0-21swapper/123:42:421
1297999291,4cyclictest26770-21/usr/sbin/munin23:37:391
12975992924,3cyclictest9-21ksoftirqd/023:02:440
12975992924,3cyclictest9-21ksoftirqd/001:52:500
12975992924,3cyclictest9-21ksoftirqd/001:12:270
12975992924,3cyclictest9-21ksoftirqd/000:32:260
151891280,1ptp4l401ktimersoftd/300:31:163
1299299281,7cyclictest734-21sed23:47:563
1298699281,24cyclictest31760-21/usr/sbin/munin23:47:422
12975992823,3cyclictest9-21ksoftirqd/023:12:440
12975992823,3cyclictest9-21ksoftirqd/003:12:510
12975992823,3cyclictest9-21ksoftirqd/002:02:290
12975992823,3cyclictest9-21ksoftirqd/000:32:590
12975992822,4cyclictest9-21ksoftirqd/022:39:380
12975992822,3cyclictest9-21ksoftirqd/002:02:560
12975992822,3cyclictest9-21ksoftirqd/001:27:590
12975992821,4cyclictest9-21ksoftirqd/001:47:460
12992992720,4cyclictest41-21ksoftirqd/323:01:013
1299299271,2cyclictest121rcu_preempt01:21:353
12975992722,3cyclictest9-21ksoftirqd/023:57:250
12975992722,3cyclictest9-21ksoftirqd/023:42:450
12975992722,3cyclictest9-21ksoftirqd/022:27:430
12975992722,3cyclictest9-21ksoftirqd/022:07:240
12975992722,3cyclictest9-21ksoftirqd/000:42:410
12975992722,3cyclictest9-21ksoftirqd/000:37:560
12975992721,3cyclictest9-21ksoftirqd/002:17:280
12975992721,3cyclictest9-21ksoftirqd/000:22:390
12975992721,3cyclictest9-21ksoftirqd/000:12:480
12975992720,4cyclictest9-21ksoftirqd/022:59:410
151891260,1ptp4l401ktimersoftd/323:15:233
151891260,1ptp4l401ktimersoftd/322:12:553
151891260,1ptp4l401ktimersoftd/302:23:473
151891260,0ptp4l401ktimersoftd/323:18:583
151891260,0ptp4l401ktimersoftd/323:18:583
12992992619,4cyclictest41-21ksoftirqd/322:36:483
12992992619,4cyclictest41-21ksoftirqd/322:03:563
12975992621,3cyclictest9-21ksoftirqd/001:32:440
12975992620,3cyclictest9-21ksoftirqd/022:17:350
12975992619,4cyclictest9-21ksoftirqd/022:23:280
1297599261,4cyclictest8516-21sendmail-msp02:32:290
151891250,2ptp4l401ktimersoftd/322:45:503
151891250,1ptp4l401ktimersoftd/323:27:393
151891250,1ptp4l401ktimersoftd/301:30:393
151891250,1ptp4l401ktimersoftd/301:12:473
151891250,1ptp4l401ktimersoftd/300:57:403
151891250,1ptp4l401ktimersoftd/300:57:403
151891250,1ptp4l401ktimersoftd/300:47:393
12992992519,3cyclictest41-21ksoftirqd/322:50:023
12975992520,3cyclictest9-21ksoftirqd/003:07:490
12975992520,3cyclictest9-21ksoftirqd/001:27:280
12975992518,4cyclictest9-21ksoftirqd/023:30:240
151891240,1ptp4l401ktimersoftd/322:22:443
151891240,1ptp4l401ktimersoftd/303:02:563
151891240,1ptp4l401ktimersoftd/301:53:013
151891240,1ptp4l401ktimersoftd/301:34:263
151891240,1ptp4l401ktimersoftd/301:22:433
151891240,1ptp4l401ktimersoftd/300:52:503
151891240,0ptp4l401ktimersoftd/322:18:243
12992992415,5cyclictest26341-21if_ens301:37:453
12975992419,3cyclictest9-21ksoftirqd/023:37:430
12975992419,3cyclictest9-21ksoftirqd/023:22:400
12975992418,3cyclictest9-21ksoftirqd/022:16:360
12975992318,3cyclictest9-21ksoftirqd/023:32:480
12975992318,3cyclictest9-21ksoftirqd/001:42:460
12975992316,4cyclictest9-21ksoftirqd/023:22:210
12975992316,4cyclictest9-21ksoftirqd/023:22:210
12975992114,4cyclictest900-21df22:42:390
12975992114,4cyclictest27384-21sh01:02:390
12975992010,6cyclictest31499-21apt-get23:47:390
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional