You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-01-25 - 06:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackeslot2.osadl.org (updated Sat Jan 25, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11423821520,1sleep10-21swapper/120:30:301
2020902890,2sleep30-21swapper/321:40:173
2966202550,3sleep20-21swapper/222:40:202
9179992624,1cyclictest0-21swapper/121:40:031
9177992622,1cyclictest2934901systemd-run22:40:000
9177992615,6cyclictest0-21swapper/000:10:020
9179992515,3cyclictest0-21swapper/121:20:001
9179992515,3cyclictest0-21swapper/119:20:001
9179992512,3cyclictest253618-21apt-get22:15:031
25010912518,2phc2sys0-21swapper/322:59:153
25010912518,2phc2sys0-21swapper/321:55:103
25010912517,6phc2sys0-21swapper/300:39:333
9179992414,3cyclictest9174-21cyclictest23:34:501
9179992414,2cyclictest0-21swapper/122:55:011
9179992413,3cyclictest350688-21kthreadcore23:15:231
9177992416,7cyclictest459910-21cut00:30:000
25010912418,3phc2sys0-21swapper/300:27:233
25010912418,2phc2sys0-21swapper/322:28:373
25010912418,2phc2sys0-21swapper/321:54:383
25010912418,2phc2sys0-21swapper/321:45:363
25010912418,2phc2sys0-21swapper/321:36:263
25010912418,2phc2sys0-21swapper/321:33:183
25010912418,2phc2sys0-21swapper/321:13:253
25010912418,2phc2sys0-21swapper/320:32:013
25010912418,2phc2sys0-21swapper/320:21:313
25010912418,2phc2sys0-21swapper/320:00:193
25010912418,2phc2sys0-21swapper/319:15:233
25010912418,2phc2sys0-21swapper/300:15:373
25010912417,2phc2sys0-21swapper/323:52:413
25010912417,2phc2sys0-21swapper/323:32:293
25010912417,2phc2sys0-21swapper/322:21:073
9177992315,7cyclictest215287-21ps21:50:170
25010912318,3phc2sys0-21swapper/323:57:213
25010912318,3phc2sys0-21swapper/323:28:393
25010912318,3phc2sys0-21swapper/323:08:313
25010912318,3phc2sys0-21swapper/320:36:173
25010912318,3phc2sys0-21swapper/320:05:313
25010912317,3phc2sys0-21swapper/300:00:053
25010912317,2phc2sys0-21swapper/323:45:073
25010912317,2phc2sys0-21swapper/323:22:073
25010912317,2phc2sys0-21swapper/323:10:053
25010912317,2phc2sys0-21swapper/323:00:473
25010912317,2phc2sys0-21swapper/323:00:473
25010912317,2phc2sys0-21swapper/322:42:393
25010912317,2phc2sys0-21swapper/322:02:313
25010912317,2phc2sys0-21swapper/320:51:253
25010912317,2phc2sys0-21swapper/319:55:553
25010912317,2phc2sys0-21swapper/319:33:593
25010912317,2phc2sys0-21swapper/319:28:053
25010912317,2phc2sys0-21swapper/319:12:553
25010912317,2phc2sys0-21swapper/300:11:453
16735822318,3sleep30-21swapper/321:16:013
9179992219,2cyclictest42196-21gpgconf19:35:011
9179992217,3cyclictest178850irq/121-eno123:30:011
9179992213,2cyclictest178850irq/121-eno100:12:291
9179992212,2cyclictest152249-21kworker/u16:1-events_power_efficient21:50:001
917799226,11cyclictest2015-21snmpd22:15:220
9177992219,2cyclictest200899-21apt-key21:40:010
9177992217,1cyclictest924598rtkit-daemon19:55:280
9177992216,2cyclictest178850irq/121-eno123:10:180
9177992213,5cyclictest332236-21sshd23:03:300
9177992213,5cyclictest332236-21sshd23:03:290
9177992210,10cyclictest0-21swapper/022:30:240
917799220,8cyclictest307609-21cat22:50:160
44570522218,2sleep20-21swapper/200:17:362
39358222218,2sleep20-21swapper/223:43:332
37694022218,2sleep30-21swapper/323:35:093
34361822218,2sleep20-21swapper/223:11:432
29156222218,2sleep20-21swapper/222:37:122
25010912217,3phc2sys0-21swapper/323:15:533
25010912217,3phc2sys0-21swapper/322:47:153
25010912217,3phc2sys0-21swapper/322:34:253
25010912217,3phc2sys0-21swapper/322:11:563
25010912217,3phc2sys0-21swapper/320:12:573
25010912217,3phc2sys0-21swapper/319:50:533
25010912217,3phc2sys0-21swapper/319:41:273
25010912217,3phc2sys0-21swapper/300:09:233
25010912215,3phc2sys0-21swapper/321:28:013
2451422218,2sleep30-21swapper/319:20:203
24160322218,2sleep30-21swapper/322:05:433
19819322218,2sleep20-21swapper/221:36:122
918099212,2cyclictest0-21swapper/222:21:412
9180992114,3cyclictest0-21swapper/222:50:102
9179992111,3cyclictest191rcu_preempt23:51:571
917799215,5cyclictest48695-21aten2.4-expect19:40:210
9177992114,1cyclictest191rcu_preempt19:15:210
9177992110,7cyclictest319678-21cut22:55:220
6036522118,2sleep30-21swapper/319:49:573
4847922117,2sleep20-21swapper/219:40:022
47516322117,2sleep20-21swapper/200:35:562
45962322117,2sleep20-21swapper/200:29:392
42790322117,2sleep20-21swapper/200:07:542
41706922117,2sleep20-21swapper/200:00:052
40509122117,2sleep20-21swapper/223:51:312
39596522117,2sleep20-21swapper/223:46:222
37381022117,2sleep20-21swapper/223:30:512
36034022117,2sleep20-21swapper/223:20:252
35317522117,2sleep20-21swapper/223:17:162
33130422117,2sleep20-21swapper/223:02:052
33130422117,2sleep20-21swapper/223:02:052
32221022117,2sleep20-21swapper/222:56:562
30567222117,2sleep20-21swapper/222:49:072
28155622117,2sleep20-21swapper/222:30:392
27395122117,2sleep20-21swapper/222:27:472
26082622117,2sleep20-21swapper/222:16:562
25010912118,2phc2sys0-21swapper/320:27:093
25010912117,2phc2sys0-21swapper/322:52:153
25010912117,2phc2sys0-21swapper/322:36:113
25010912117,2phc2sys0-21swapper/322:15:553
24391522117,2sleep20-21swapper/222:09:192
23896122117,2sleep20-21swapper/222:02:132
22964222117,2sleep20-21swapper/221:56:522
21989322117,2sleep20-21swapper/221:50:432
21283722117,2sleep20-21swapper/221:48:432
18117222117,2sleep20-21swapper/221:27:472
1787922117,2sleep20-21swapper/219:15:142
17726622117,2sleep20-21swapper/221:22:222
16136822117,2sleep20-21swapper/221:15:082
15173322118,2sleep30-21swapper/321:07:043
10324622117,2sleep20-21swapper/220:25:152
9180992017,1cyclictest0-21swapper/223:40:002
9179992017,2cyclictest1726-21systemd-logind23:40:021
9179992017,2cyclictest15968-21kworker/u16:3-ext4-rsv-conversion21:15:011
9179992015,1cyclictest178850irq/121-eno122:10:011
917799209,7cyclictest447755-21ssh00:20:130
917799209,7cyclictest360562-21sendmail_mailqu23:20:260
917799209,5cyclictest1695-21dbus-daemon22:50:000
917799204,3cyclictest369348-21kthreadcore23:30:170
9177992018,1cyclictest15343-21cron19:15:010
9177992013,6cyclictest347453-21sed23:15:210
9177992013,6cyclictest163535-21kthreadcore21:15:200
9177992012,2cyclictest151974-21diskmemload22:20:230
9177992011,5cyclictest91322-21cpuspeed_turbos20:15:160
9177992011,5cyclictest1-21systemd21:30:020
9177992010,6cyclictest382011-21ssh23:35:270
9177992010,6cyclictest120025-21grub-editenv20:35:270
8458822017,2sleep20-21swapper/220:09:442
7820322017,2sleep20-21swapper/220:00:382
6641322017,2sleep20-21swapper/219:54:452
6011122017,2sleep20-21swapper/219:46:442
4787722017,2sleep20-21swapper/219:36:022
44870922017,2sleep20-21swapper/200:20:212
4166122017,2sleep20-21swapper/219:32:452
3544522017,2sleep20-21swapper/219:26:122
2935622017,2sleep20-21swapper/219:20:352
25184322017,2sleep20-21swapper/222:12:192
25010912017,2phc2sys0-21swapper/321:01:413
25010912017,2phc2sys0-21swapper/320:40:573
25010912017,2phc2sys0-21swapper/320:16:033
25010912017,2phc2sys0-21swapper/319:37:413
25010912017,2phc2sys0-21swapper/300:31:053
25010912017,2phc2sys0-21swapper/300:21:333
25010912014,2phc2sys0-21swapper/321:20:023
15169122017,2sleep20-21swapper/221:06:302
1498422017,2sleep20-21swapper/219:10:292
14580422017,2sleep20-21swapper/221:03:382
13959422017,2sleep30-21swapper/320:56:183
13956322017,2sleep20-21swapper/220:55:532
13358122017,2sleep20-21swapper/220:51:482
12754022017,2sleep20-21swapper/220:46:552
12697822017,2sleep20-21swapper/220:43:382
12081022017,2sleep20-21swapper/220:37:252
11469922017,2sleep20-21swapper/220:32:002
10251022017,2sleep20-21swapper/220:21:102
918099195,7cyclictest0-21swapper/223:30:012
917999197,2cyclictest178850irq/121-eno121:40:181
917999196,4cyclictest119638-21tr20:35:261
9179991916,2cyclictest0-21swapper/100:10:021
9179991910,2cyclictest0-21swapper/120:15:021
917799198,7cyclictest464232-21cut00:30:180
917799198,7cyclictest224387-21sed21:55:210
917799197,5cyclictest437053-21diskmemload00:13:080
917799193,5cyclictest134318-21aten2.4-expect20:55:190
9177991916,2cyclictest367641-21ssh23:30:010
9177991911,4cyclictest0-21swapper/021:10:320
9177991911,2cyclictest183844-21gltestperf21:30:160
9177991910,5cyclictest337038-21munin-plugin-st23:10:020
917999189,4cyclictest0-21swapper/123:00:131
917999189,4cyclictest0-21swapper/123:00:131
917999183,6cyclictest29736-21perf19:25:011
9179991816,1cyclictest0-21swapper/123:25:001
9179991815,2cyclictest465522-21switchtime00:30:221
9179991815,2cyclictest1726-21systemd-logind19:30:011
9179991815,2cyclictest127894-21systemd-run20:50:011
9179991815,2cyclictest1-21systemd19:45:021
917799189,2cyclictest201467-21/usr/sbin/munin21:40:170
917799188,6cyclictest233674-21cat22:00:240
917799185,8cyclictest1-21systemd20:30:020
917799185,2cyclictest241rcuc/023:50:140
917799184,4cyclictest30148-21aten2.4-expect19:25:150
9177991815,2cyclictest9174-21cyclictest19:20:250
9177991815,2cyclictest472203-21kthreadcore00:35:230
9177991815,2cyclictest440124-21kthreadcore00:15:210
9177991815,2cyclictest295525-21kthreadcore22:40:200
9177991815,2cyclictest1696-1atopacctd20:14:310
9177991813,4cyclictest390210-21kthreadcore23:40:220
9177991813,1cyclictest191rcu_preempt21:46:060
9177991812,5cyclictest408434-21/usr/sbin/munin23:55:160
9177991812,5cyclictest246420-21kthreadcore22:10:170
9177991812,5cyclictest170783-21sort21:20:170
9177991812,5cyclictest100135-21kthreadcore20:20:230
9177991812,5cyclictest0-21swapper/000:01:380
9177991811,1cyclictest179201-21kworker/u16:2+xprtiod22:26:580
9177991810,1cyclictest444361kthreadcore19:35:190
917799180,16cyclictest770595-21systemd-journal20:04:300
918099173,1cyclictest0-21swapper/220:16:092
917999178,5cyclictest191rcu_preempt22:00:281
9179991715,1cyclictest460035-21cut00:30:021
9179991714,2cyclictest450650-21kthreadcore00:20:231
9179991714,2cyclictest318612-21kthreadcore22:55:221
9179991714,2cyclictest231879-21latency_hist22:00:011
9179991710,2cyclictest178850irq/121-eno122:45:021
917999170,4cyclictest398394-21munin-run23:50:011
917799178,6cyclictest179201-21kworker/u16:2+rpciod22:08:350
9177991714,2cyclictest1696-1atopacctd20:42:300
9177991714,2cyclictest149030-21kthreadcore21:05:220
9177991714,2cyclictest145332-21timerandwakeup21:00:260
9177991714,2cyclictest129427-21kthreadcore20:50:170
9177991714,2cyclictest112014-21kthreadcore20:30:270
25010911712,1phc2sys0-21swapper/320:45:093
9180991612,2cyclictest0-21swapper/200:30:132
9180991612,2cyclictest0-21swapper/200:00:022
917999168,1cyclictest178850irq/121-eno100:35:231
917999167,2cyclictest36-21ksoftirqd/123:10:121
917999167,1cyclictest178850irq/121-eno122:32:321
917999165,2cyclictest178850irq/121-eno123:55:161
917999164,4cyclictest214134-21apt-get21:50:111
917999161,7cyclictest262858-21latency_hist22:20:021
917999161,6cyclictest8902-21latency_hist19:10:021
917999161,6cyclictest447321-21latency_hist00:20:031
9179991613,2cyclictest333068-21kworker/u16:1-rpciod00:00:291
9179991613,2cyclictest293599-21apt-config22:40:001
9179991613,2cyclictest0-21swapper/121:30:221
9179991613,1cyclictest178850irq/121-eno123:45:011
9179991611,4cyclictest96874-21kworker/u16:0-writeback21:00:021
917999160,9cyclictest10369-21basename19:10:171
917999160,8cyclictest341rcuc/120:30:011
917799167,5cyclictest3971742sleep023:48:120
9177991613,2cyclictest9403-21sh19:10:010
9177991613,2cyclictest79469-21fschecks_count20:05:150
9177991613,2cyclictest65525-21pmu-power19:50:270
9177991613,2cyclictest54936-21cpuspeed_turbos19:45:160
9177991613,2cyclictest40551-21kthreadcore19:30:280
39319621613,2sleep30-21swapper/323:42:583
924598150,2rtkit-daemon0-21swapper/119:35:081
9180991513,1cyclictest0-21swapper/221:30:132
9180991513,1cyclictest0-21swapper/221:15:002
917999158,1cyclictest501rcuop/220:01:461
917999156,2cyclictest178850irq/121-eno123:05:051
917999155,2cyclictest275441-21latency_hist22:30:001
917999155,2cyclictest178850irq/121-eno121:23:061
917999154,4cyclictest60670-21cat19:50:021
917999154,3cyclictest36-21ksoftirqd/121:27:461
917999151,6cyclictest84621-21latency_hist20:10:021
917999151,2cyclictest72474-21latency_hist20:00:011
9179991512,2cyclictest92328-21kthreadcore20:15:211
9179991512,2cyclictest63491-21kthreadcore19:50:241
9179991512,2cyclictest1726-21systemd-logind22:50:011
918099141,9cyclictest0-21swapper/200:14:562
9180991411,1cyclictest0-21swapper/221:44:062
9180991411,1cyclictest0-21swapper/220:00:022
917999147,2cyclictest178850irq/121-eno122:22:041
917999142,4cyclictest102895-21cat20:25:001
9179991411,2cyclictest126325-21mailstats20:40:251
9179991410,3cyclictest142418-21kthreadcore21:00:201
9179991410,3cyclictest129427-21kthreadcore20:50:171
917799140,5cyclictest127968-21cat20:50:010
918099139,2cyclictest0-21swapper/220:10:262
918099134,2cyclictest0-21swapper/223:05:462
9180991310,1cyclictest0-21swapper/219:10:012
917999127,3cyclictest178850irq/121-eno121:05:151
250109181,2phc2sys0-21swapper/319:05:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional