You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 16:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Fri Dec 05, 2025 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2461521680,4sleep1513699cyclictest12:05:491
1773911010,34ptp4l401ktimersoftd/308:24:293
268172720,2sleep00-21swapper/010:52:050
152042680,2sleep00-21swapper/013:51:150
49032674,9sleep00-21swapper/008:23:070
49262604,10sleep10-21swapper/108:23:251
56832540,4sleep2514199cyclictest12:24:492
514999525,12cyclictest5261-21if_enp1s0.111:05:033
325132510,1sleep30-21swapper/313:35:083
45162500,4sleep233-21ksoftirqd/211:04:482
514999456,16cyclictest7741-21runrttasks11:45:273
5141994533,6cyclictest33-21ksoftirqd/212:50:002
514999445,8cyclictest23113-21hddtemp_smartct12:05:063
514999443,11cyclictest844-21rm11:39:053
513699391,4cyclictest18453-21apt-get12:00:021
177391390,1ptp4l401ktimersoftd/313:52:233
513699382,31cyclictest27331-21ssh13:30:031
513699382,31cyclictest27331-21ssh13:30:031
513699380,5cyclictest8196-21rm11:46:281
177391380,1ptp4l401ktimersoftd/313:32:273
177391380,1ptp4l401ktimersoftd/313:32:273
177391380,1ptp4l401ktimersoftd/313:26:343
177391380,1ptp4l401ktimersoftd/313:04:333
177391380,1ptp4l401ktimersoftd/312:45:233
177391380,1ptp4l401ktimersoftd/312:34:073
177391380,1ptp4l401ktimersoftd/312:00:473
177391380,1ptp4l401ktimersoftd/311:24:453
177391380,1ptp4l401ktimersoftd/311:12:053
177391380,1ptp4l401ktimersoftd/311:00:223
177391380,1ptp4l401ktimersoftd/310:40:143
177391380,1ptp4l401ktimersoftd/310:38:183
5149993720,9cyclictest3937-21apt-get13:40:043
513699372,6cyclictest21978-21apt-get12:45:021
5136993712,21cyclictest7920-21sed13:05:101
513699370,5cyclictest8165-21sort13:44:511
177391370,1ptp4l401ktimersoftd/313:23:453
177391370,1ptp4l401ktimersoftd/313:17:193
177391370,1ptp4l401ktimersoftd/312:54:573
177391370,1ptp4l401ktimersoftd/312:50:203
177391370,1ptp4l401ktimersoftd/312:37:173
177391370,1ptp4l401ktimersoftd/312:25:213
177391370,1ptp4l401ktimersoftd/311:56:113
177391370,1ptp4l401ktimersoftd/311:14:503
177391370,1ptp4l401ktimersoftd/310:47:373
177391370,1ptp4l401ktimersoftd/310:31:523
177391370,1ptp4l401ktimersoftd/309:47:063
177391370,1ptp4l401ktimersoftd/308:54:583
177391370,1ptp4l401ktimersoftd/308:39:553
177391370,0ptp4l401ktimersoftd/311:25:563
513699363,7cyclictest29813-21apt-get11:34:591
5136993620,13cyclictest25-21ksoftirqd/110:17:341
5136993619,14cyclictest25-21ksoftirqd/110:07:261
5136993614,19cyclictest31140-21if_enp1s012:15:061
513699361,32cyclictest15563-21chrt11:55:091
5136993612,21cyclictest20134-21expr10:45:011
177391360,1ptp4l401ktimersoftd/311:40:443
177391360,1ptp4l401ktimersoftd/311:40:443
177391360,1ptp4l401ktimersoftd/310:54:113
177391360,1ptp4l401ktimersoftd/310:25:193
177391360,1ptp4l401ktimersoftd/309:01:453
177391360,0ptp4l401ktimersoftd/312:16:203
5149993519,7cyclictest28346-21apt-get09:54:573
5149993519,7cyclictest28346-21apt-get09:54:573
513699352,5cyclictest0-21swapper/110:39:591
513699352,4cyclictest0-21swapper/109:54:581
513699352,4cyclictest0-21swapper/109:54:581
513699351,31cyclictest18972-21grep12:40:101
5136993511,21cyclictest6247-21grep12:25:041
513699350,4cyclictest24856-21irqrtprio10:50:031
5131993528,4cyclictest25186-21sh11:29:470
5141993429,3cyclictest33-21ksoftirqd/212:30:032
5141993428,3cyclictest33-21ksoftirqd/212:45:132
513699348,4cyclictest13323-21ls10:35:141
513699341,5cyclictest0-21swapper/111:24:591
5136993413,18cyclictest46950irq/101-ens3-Tx10:54:541
5136993411,20cyclictest6039-21irqrtprio08:25:001
5141993321,10cyclictest33-21ksoftirqd/211:10:072
513699339,21cyclictest1516-21latency11:00:061
513699339,21cyclictest14007-21missed_timers13:50:081
513699339,21cyclictest13183-21basename08:54:441
513699338,22cyclictest28359-21grep12:10:341
513699335,25cyclictest0-21swapper/111:19:301
513699335,24cyclictest12784-21latency_hist13:49:511
513699332,6cyclictest18645-21snmp_o5powerctl11:20:131
513699331,5cyclictest0-21swapper/110:09:551
5136993311,19cyclictest2369-21expr12:20:031
5136993311,19cyclictest13061-21sh11:53:101
5136993311,18cyclictest3007-21diskmemload12:37:431
5136993310,19cyclictest23963-21latency_hist09:34:451
5136993310,19cyclictest13417-21basename08:54:541
513699330,5cyclictest26926-21cut12:50:061
513699330,30cyclictest3007-21diskmemload11:10:351
5141993225,4cyclictest33-21ksoftirqd/213:40:042
5141993216,13cyclictest22552-21ps11:25:092
513699327,4cyclictest25653-21cut11:30:001
513699324,5cyclictest7904-21df10:29:591
513699320,4cyclictest21589-21hddtemp_smartct09:25:011
513699320,29cyclictest3115-21rm13:38:591
326262320,5sleep09-21ksoftirqd/012:15:520
5149993119,6cyclictest26678-21apt-get12:10:013
5141993126,3cyclictest33-21ksoftirqd/213:15:012
5141993125,4cyclictest33-21ksoftirqd/210:50:032
5141993125,3cyclictest33-21ksoftirqd/211:40:072
5141993125,3cyclictest33-21ksoftirqd/211:40:072
513699319,19cyclictest19335-21cron09:14:451
513699317,3cyclictest24547-21date09:39:451
513699316,4cyclictest19171-21fschecks_count13:20:071
513699316,2cyclictest0-21swapper/108:39:591
513699313,7cyclictest4662-21apt-get11:04:581
513699311,3cyclictest15298-21grep13:15:031
5136993112,16cyclictest10750-21irqstats12:30:081
513699310,4cyclictest30701-21cpuspeed_turbos12:55:021
5141993025,3cyclictest33-21ksoftirqd/211:20:062
5141993025,3cyclictest33-21ksoftirqd/209:39:572
5141993024,3cyclictest33-21ksoftirqd/213:50:012
514199300,6cyclictest29811-21ssh11:34:592
513699309,18cyclictest12470-21seq08:48:481
513699307,3cyclictest25924-21ptp4l09:40:061
513699307,3cyclictest11767-21/usr/sbin/munin13:10:091
513699302,7cyclictest4007-21snmp_o5powerctl13:00:171
513699302,5cyclictest3103-21snmp_o5powerctl11:40:141
513699302,5cyclictest3103-21snmp_o5powerctl11:40:141
513699300,27cyclictest3007-21diskmemload10:25:041
5141992924,3cyclictest33-21ksoftirqd/213:30:202
5141992924,3cyclictest33-21ksoftirqd/213:30:202
5141992924,3cyclictest33-21ksoftirqd/210:34:472
5141992923,3cyclictest33-21ksoftirqd/213:07:592
513699297,3cyclictest278052chrt09:52:241
513699294,5cyclictest24396-21snmp_o5powerctl13:25:171
513699291,5cyclictest9616-21apt-config08:39:441
513699291,5cyclictest7959-21munin-node08:29:451
513699291,5cyclictest20123-21ls09:19:441
5131992922,4cyclictest9-21ksoftirqd/009:46:170
15862291,3sleep01647-21acpi11:40:000
15862291,3sleep01647-21acpi11:40:000
5149992822,3cyclictest41-21ksoftirqd/309:24:443
514199285,13cyclictest28011-21apt-get09:54:582
514199285,13cyclictest28011-21apt-get09:54:582
5141992823,3cyclictest33-21ksoftirqd/213:00:072
5141992823,3cyclictest33-21ksoftirqd/211:54:482
5141992822,3cyclictest33-21ksoftirqd/209:50:512
5141992822,3cyclictest33-21ksoftirqd/208:39:442
5141992821,4cyclictest33-21ksoftirqd/209:19:212
513699286,3cyclictest227-21systemd-journal09:04:441
5136992822,3cyclictest25-21ksoftirqd/109:07:191
513699281,5cyclictest3180-21cut10:24:461
5131992822,3cyclictest9-21ksoftirqd/008:29:530
48332286,10sleep20-21swapper/208:22:122
5149992721,3cyclictest41-21ksoftirqd/309:26:173
5149992717,5cyclictest6960-21apt-get13:05:023
5141992722,3cyclictest33-21ksoftirqd/212:10:082
5141992722,3cyclictest33-21ksoftirqd/211:30:112
5141992722,3cyclictest33-21ksoftirqd/209:14:452
5141992721,3cyclictest33-21ksoftirqd/213:20:162
5141992715,3cyclictest33-21ksoftirqd/212:00:012
513699274,3cyclictest27554-21latency_hist09:49:451
513699270,5cyclictest31202-21sh10:04:451
513199274,14cyclictest25566-21ssh11:29:590
5131992721,4cyclictest9-21ksoftirqd/010:01:590
5131992721,3cyclictest9-21ksoftirqd/013:27:260
5131992721,3cyclictest9-21ksoftirqd/009:36:530
5131992720,4cyclictest9-21ksoftirqd/012:43:100
5131992720,4cyclictest9-21ksoftirqd/011:00:440
5149992620,4cyclictest41-21ksoftirqd/310:06:033
5149992619,4cyclictest41-21ksoftirqd/309:05:053
5149992618,5cyclictest41-21ksoftirqd/313:44:553
5149992612,9cyclictest0-21swapper/308:24:533
5149992612,10cyclictest0-21swapper/312:40:013
5141992621,3cyclictest33-21ksoftirqd/212:35:082
5141992620,4cyclictest33-21ksoftirqd/212:17:142
5141992620,3cyclictest33-21ksoftirqd/212:55:012
5141992620,3cyclictest33-21ksoftirqd/211:00:052
5141992619,4cyclictest33-21ksoftirqd/210:00:562
5141992617,7cyclictest33-21ksoftirqd/213:37:142
5131992620,3cyclictest9-21ksoftirqd/012:28:480
5131992619,4cyclictest9-21ksoftirqd/010:44:220
5149992519,3cyclictest41-21ksoftirqd/309:52:483
5149992519,3cyclictest41-21ksoftirqd/309:19:113
5141992520,3cyclictest33-21ksoftirqd/210:40:062
5141992520,3cyclictest33-21ksoftirqd/210:35:022
5141992520,3cyclictest33-21ksoftirqd/210:24:592
5141992520,3cyclictest33-21ksoftirqd/209:25:032
5141992520,3cyclictest33-21ksoftirqd/208:25:002
5141992519,4cyclictest33-21ksoftirqd/210:09:362
5141992519,3cyclictest33-21ksoftirqd/209:20:522
5141992519,3cyclictest33-21ksoftirqd/208:55:192
5141992518,4cyclictest33-21ksoftirqd/210:09:482
513199252,14cyclictest4671-21ssh11:04:580
5131992520,3cyclictest9-21ksoftirqd/010:47:560
5131992520,3cyclictest9-21ksoftirqd/010:38:550
5131992518,4cyclictest9-21ksoftirqd/010:55:300
5131992518,4cyclictest9-21ksoftirqd/010:16:400
5131992518,4cyclictest9-21ksoftirqd/009:52:560
177391250,1ptp4l401ktimersoftd/313:11:503
177391250,1ptp4l401ktimersoftd/312:24:053
177391250,1ptp4l401ktimersoftd/311:34:033
177391250,1ptp4l401ktimersoftd/310:56:313
5149992418,3cyclictest41-21ksoftirqd/309:38:373
5149992411,10cyclictest9365-21awk08:39:433
5149992410,11cyclictest7782-21munin-node08:29:443
5141992419,3cyclictest33-21ksoftirqd/212:25:062
5141992419,3cyclictest24721-21tail13:25:212
5141992418,4cyclictest33-21ksoftirqd/210:59:022
5141992418,4cyclictest33-21ksoftirqd/209:32:302
5141992418,4cyclictest33-21ksoftirqd/209:09:262
5141992418,4cyclictest33-21ksoftirqd/208:43:042
5141992418,3cyclictest33-21ksoftirqd/209:34:492
5141992417,5cyclictest33-21ksoftirqd/208:33:372
5141992417,4cyclictest33-21ksoftirqd/210:22:402
5141992417,4cyclictest33-21ksoftirqd/208:47:102
513699240,4cyclictest20500-21taskset09:23:421
513199249,8cyclictest101ktimersoftd/011:50:020
513199244,18cyclictest16997-21kworker/0:212:50:070
513199243,11cyclictest29821-21ssh11:34:590
5131992419,3cyclictest9-21ksoftirqd/012:05:090
5131992418,4cyclictest9-21ksoftirqd/010:13:350
5131992418,3cyclictest9-21ksoftirqd/012:36:570
5131992418,3cyclictest9-21ksoftirqd/011:45:320
5131992418,3cyclictest9-21ksoftirqd/010:30:570
5131992418,3cyclictest9-21ksoftirqd/009:57:240
5131992418,3cyclictest9-21ksoftirqd/009:57:240
5131992417,4cyclictest9-21ksoftirqd/013:40:150
5131992417,4cyclictest9-21ksoftirqd/013:38:460
5131992417,4cyclictest9-21ksoftirqd/009:14:420
5131992417,4cyclictest9-21ksoftirqd/009:04:440
513199241,20cyclictest10864-21apt-get13:10:020
177391240,1ptp4l401ktimersoftd/311:50:003
177391240,1ptp4l401ktimersoftd/310:10:023
177391240,1ptp4l401ktimersoftd/309:39:583
177391240,1ptp4l401ktimersoftd/309:09:473
5149992316,4cyclictest41-21ksoftirqd/310:15:033
5141992317,4cyclictest33-21ksoftirqd/209:47:242
5141992317,3cyclictest33-21ksoftirqd/211:56:492
5131992317,3cyclictest9-21ksoftirqd/013:08:100
5131992317,3cyclictest9-21ksoftirqd/010:23:140
5131992317,3cyclictest9-21ksoftirqd/010:09:370
5131992317,3cyclictest9-21ksoftirqd/009:23:090
5131992317,3cyclictest9-21ksoftirqd/008:26:070
5131992316,4cyclictest9-21ksoftirqd/013:47:010
5131992316,4cyclictest9-21ksoftirqd/009:40:510
5131992316,4cyclictest9-21ksoftirqd/009:27:500
5131992316,4cyclictest9-21ksoftirqd/008:41:060
5131992316,4cyclictest31035-21grep12:55:050
513199231,5cyclictest16354-21snmp_o5powerctl13:15:140
177391230,1ptp4l401ktimersoftd/310:19:483
177391230,1ptp4l401ktimersoftd/310:01:173
177391230,1ptp4l401ktimersoftd/309:33:333
177391230,1ptp4l401ktimersoftd/308:45:023
5141992217,3cyclictest33-21ksoftirqd/210:49:472
5141992216,3cyclictest33-21ksoftirqd/212:40:542
5131992216,3cyclictest9-21ksoftirqd/009:18:340
5131992215,4cyclictest9-21ksoftirqd/011:55:010
177391220,1ptp4l401ktimersoftd/308:49:573
5141992116,3cyclictest33-21ksoftirqd/213:10:262
5141992116,3cyclictest33-21ksoftirqd/212:05:022
5141992115,3cyclictest33-21ksoftirqd/211:45:542
5141992115,3cyclictest33-21ksoftirqd/210:14:492
5141992115,3cyclictest33-21ksoftirqd/209:02:302
5141992114,4cyclictest8512-21/usr/sbin/munin13:45:092
5131992115,4cyclictest9-21ksoftirqd/012:11:590
5131992115,3cyclictest9-21ksoftirqd/009:06:060
5131992115,3cyclictest9-21ksoftirqd/008:35:020
5131992114,4cyclictest9-21ksoftirqd/008:52:460
5131992114,4cyclictest3059-21gltestperf13:00:070
513199210,18cyclictest1760-21runrttasks12:34:390
5131992015,3cyclictest9-21ksoftirqd/013:30:560
5131992015,3cyclictest9-21ksoftirqd/013:30:560
5131992015,3cyclictest9-21ksoftirqd/010:29:290
5131992014,4cyclictest21000-21ssh13:21:050
5131992014,3cyclictest17693-21tr11:20:040
5131992013,4cyclictest9-21ksoftirqd/012:21:300
5131992012,5cyclictest18851-21fschecks_time12:00:060
5141991913,3cyclictest13378-21awk11:15:062
5131991915,2cyclictest0-21swapper/011:15:050
5131991915,2cyclictest0-21swapper/008:46:200
5131991913,3cyclictest10410-21threads11:10:170
5131991912,4cyclictest1760-21runrttasks12:45:090
5131991912,4cyclictest13730-21expr08:54:560
5131991812,3cyclictest1760-21runrttasks09:32:280
5141991610,3cyclictest1760-21runrttasks08:51:332
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional