You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-22 - 02:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Tue May 21, 2024 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
239472780,0sleep00-21swapper/012:03:470
310412570,6sleep1646-21dbus-daemon09:56:351
149452570,5sleep1646-21dbus-daemon10:55:151
268892560,0sleep00-21swapper/007:15:000
45272550,0sleep10-21swapper/111:16:371
15872550,1sleep00-21swapper/012:25:380
77412530,1sleep0111rcuc/012:35:520
75132530,1sleep11-21systemd11:58:311
244682530,0sleep30-21swapper/312:03:493
35292520,0sleep30-21swapper/310:10:343
155682520,0sleep30-21swapper/312:33:333
35502510,0sleep10-21swapper/110:40:451
314892510,0sleep30-21swapper/312:08:103
91192500,0sleep30-21swapper/311:48:473
274132500,0sleep20-21swapper/209:21:432
23352490,1sleep2321ktimersoftd/210:06:572
155782490,1sleep315580-21bash12:37:073
145652490,0sleep10-21swapper/109:54:471
81112480,0sleep30-21swapper/309:30:093
62932480,0sleep30-21swapper/311:23:163
179102480,0sleep20-21swapper/209:44:462
171082470,0sleep00-21swapper/009:30:580
313122440,0sleep10-21swapper/111:34:441
112632440,1sleep211240-21sshd09:13:312
287102430,2sleep22485699cyclictest11:03:042
313752420,0sleep10-21swapper/110:46:491
225102400,0sleep1241ktimersoftd/109:11:131
168502370,0sleep30-21swapper/311:17:523
221492360,0sleep20-21swapper/212:30:562
2457223423,7sleep30-21swapper/307:07:553
142982340,1sleep2646-21dbus-daemon12:06:252
87902290,0sleep38792-21id11:51:523
247442298,7sleep00-21swapper/007:09:570
245152298,7sleep20-21swapper/207:07:152
2459022312,6sleep10-21swapper/107:08:101
15502200,1sleep30-21swapper/311:06:473
87062180,1sleep38698-21sshd10:44:363
271202170,1sleep027104-21lspci11:22:060
271402160,0sleep00-21swapper/010:23:090
153302160,0sleep20-21swapper/211:08:102
145962160,1sleep3692-21NetworkManager12:23:493
81282150,0sleep10-21swapper/109:16:261
64442150,1sleep2321ktimersoftd/209:36:342
2484699150,13cyclictest8989-21sshd11:48:480
103132150,0sleep00-21swapper/012:09:190
78252140,1sleep17827-21grep09:05:121
49022140,0sleep00-21swapper/009:50:170
42692140,0sleep04268-21bash10:00:300
131532140,1sleep1231rcuc/111:23:591
54652130,0sleep10-21swapper/112:05:121
203712130,0sleep20-21swapper/212:00:122
5822120,0sleep20-21swapper/210:03:262
2486399120,1cyclictest26825-21grep09:45:353
2485699125,1cyclictest33-21ksoftirqd/210:57:442
24856991210,1cyclictest0-21swapper/211:35:272
2485699120,1cyclictest28174-21lspci11:44:172
2485699120,11cyclictest31296-21bash10:20:172
2485699120,11cyclictest25286-21lspci09:55:572
2485699120,11cyclictest0-21swapper/211:45:282
2485299120,1cyclictest30067-21sshd11:12:431
2485299120,11cyclictest4055-21sshd12:22:431
2485299120,11cyclictest17687-21lspci09:24:031
153942120,0sleep20-21swapper/211:30:132
2486399119,1cyclictest75550irq/24-eno1-rx-11:37:263
24863991110,0cyclictest0-21swapper/311:55:073
2486399110,10cyclictest0-21swapper/310:08:153
2486399110,10cyclictest0-21swapper/309:05:453
2485699118,2cyclictest33-21ksoftirqd/212:17:312
24856991110,0cyclictest0-21swapper/212:21:292
24856991110,0cyclictest0-21swapper/211:28:372
24856991110,0cyclictest0-21swapper/210:37:172
2485699110,3cyclictest33-21ksoftirqd/209:52:242
2485699110,10cyclictest0-21swapper/210:47:472
2485699110,0cyclictest0-21swapper/209:45:572
2485299119,1cyclictest28997-21bash09:42:341
24852991110,0cyclictest0-21swapper/110:22:331
2485299110,10cyclictest0-21swapper/112:03:441
2485299110,10cyclictest0-21swapper/110:27:331
2485299110,10cyclictest0-21swapper/109:29:041
2485299110,10cyclictest0-21swapper/109:00:041
2485299110,10cyclictest0-21swapper/108:10:141
2484699119,1cyclictest646-21dbus-daemon10:09:270
24846991110,0cyclictest0-21swapper/010:57:080
2484699110,10cyclictest0-21swapper/012:24:170
2484699110,10cyclictest0-21swapper/011:34:070
2484699110,10cyclictest0-21swapper/011:12:280
2484699110,10cyclictest0-21swapper/010:31:380
2484699110,10cyclictest0-21swapper/009:11:560
271382100,0sleep30-21swapper/310:36:303
2486399109,0cyclictest0-21swapper/312:16:563
2486399109,0cyclictest0-21swapper/312:13:563
2486399109,0cyclictest0-21swapper/310:59:163
2486399109,0cyclictest0-21swapper/310:18:163
2486399108,1cyclictest1359-21lspci09:36:003
2486399100,0cyclictest0-21swapper/311:02:063
2486399100,0cyclictest0-21swapper/309:00:153
2485699109,0cyclictest0-21swapper/211:56:382
2485699109,0cyclictest0-21swapper/208:15:172
2485699102,1cyclictest33-21ksoftirqd/211:19:272
2485699101,1cyclictest33-21ksoftirqd/210:54:182
2485699101,1cyclictest33-21ksoftirqd/209:34:482
2485699101,1cyclictest121rcu_preempt09:19:372
2485699100,1cyclictest131rcu_sched09:28:242
2485699100,0cyclictest0-21swapper/211:21:482
2485299109,0cyclictest0-21swapper/111:52:331
2485299109,0cyclictest0-21swapper/110:52:531
2485299109,0cyclictest0-21swapper/109:39:431
2485299109,0cyclictest0-21swapper/109:30:431
2485299108,1cyclictest0-21swapper/109:49:231
2485299100,0cyclictest0-21swapper/112:25:441
2485299100,0cyclictest0-21swapper/111:05:531
2485299100,0cyclictest0-21swapper/110:31:541
248512100,0sleep00-21swapper/012:14:090
2484699109,0cyclictest0-21swapper/012:18:170
2484699109,0cyclictest0-21swapper/010:12:460
2484699109,0cyclictest0-21swapper/009:18:470
2484699100,0cyclictest0-21swapper/010:27:170
2484699100,0cyclictest0-21swapper/009:36:360
248639998,0cyclictest0-21swapper/311:25:263
248639998,0cyclictest0-21swapper/309:55:353
248639998,0cyclictest0-21swapper/308:51:453
248639998,0cyclictest0-21swapper/307:44:463
248639997,1cyclictest0-21swapper/311:32:173
248639997,1cyclictest0-21swapper/310:30:253
248639990,0cyclictest0-21swapper/307:34:563
248569997,1cyclictest33-21ksoftirqd/210:26:252
248569996,2cyclictest33-21ksoftirqd/210:31:362
248569996,1cyclictest33-21ksoftirqd/211:10:032
248569995,1cyclictest33-21ksoftirqd/210:13:582
248569991,1cyclictest131rcu_sched12:28:362
248529998,0cyclictest0-21swapper/111:43:431
248529998,0cyclictest0-21swapper/110:02:331
248469999,0cyclictest0-21swapper/011:59:570
248469996,3cyclictest11056-21kworker/0:311:28:370
248469996,2cyclictest3409-21kworker/0:009:20:250
21303290,0sleep00-21swapper/011:15:080
16548290,1sleep316533-21sshd12:27:123
248639987,0cyclictest0-21swapper/310:26:063
248639987,0cyclictest0-21swapper/309:15:253
248639986,1cyclictest8336-21sshd09:43:463
248639986,1cyclictest2396-21lspci11:44:573
248639985,2cyclictest649-21avahi-daemon10:46:553
248639985,2cyclictest649-21avahi-daemon10:21:223
248639985,2cyclictest646-21dbus-daemon09:13:093
248569986,1cyclictest33-21ksoftirqd/212:35:032
248569986,1cyclictest33-21ksoftirqd/212:11:112
248569986,1cyclictest33-21ksoftirqd/211:50:132
248569986,1cyclictest33-21ksoftirqd/207:30:002
248569985,1cyclictest33-21ksoftirqd/210:15:292
248569980,0cyclictest131rcu_sched10:40:142
248529987,0cyclictest0-21swapper/112:16:431
248529987,0cyclictest0-21swapper/112:13:441
248529986,1cyclictest25-21ksoftirqd/111:25:061
248529986,1cyclictest21700-21lspci12:38:011
248529986,1cyclictest12762-21lspci11:49:101
248469987,0cyclictest0-21swapper/011:51:070
248469987,0cyclictest0-21swapper/011:08:270
248469986,2cyclictest6321-21kworker/0:209:43:000
248469986,2cyclictest5753-21kworker/0:009:47:490
248469986,2cyclictest30992-21kworker/0:412:30:050
248469986,2cyclictest2483-21kworker/0:109:57:550
248469986,2cyclictest19763-21kworker/0:010:18:320
248469986,2cyclictest1969-21kworker/0:109:29:340
248469986,1cyclictest20725-21lspci10:39:160
248469986,1cyclictest10535-21lspci10:48:010
248469984,3cyclictest26253-21sshd10:43:050
248469980,0cyclictest0-21swapper/007:34:560
248639976,0cyclictest0-21swapper/308:48:463
248639976,0cyclictest0-21swapper/308:20:463
248639976,0cyclictest0-21swapper/308:15:153
248639974,2cyclictest5396-21sshd09:53:523
248639974,2cyclictest2054-21sshd10:00:203
248639974,2cyclictest16825-21sshd10:51:533
248639973,3cyclictest700-21gdbus09:27:223
248639973,3cyclictest684-21polkitd09:20:053
248639973,2cyclictest646-21dbus-daemon11:10:483
248569975,1cyclictest33-21ksoftirqd/208:45:002
248529976,0cyclictest0-21swapper/111:01:531
248529976,0cyclictest0-21swapper/108:58:131
248529975,1cyclictest700-21gdbus12:34:331
248529975,1cyclictest26301-21lspci10:13:091
248529974,2cyclictest649-21avahi-daemon11:38:151
248529974,2cyclictest649-21avahi-daemon10:35:341
248529974,2cyclictest649-21avahi-daemon10:15:121
248529974,2cyclictest648-21systemd-logind10:05:261
248469976,0cyclictest0-21swapper/011:42:170
248469976,0cyclictest0-21swapper/008:20:260
248469975,1cyclictest649-21avahi-daemon11:36:300
248469975,1cyclictest648-21systemd-logind11:00:260
248469975,1cyclictest646-21dbus-daemon08:35:000
248469974,3cyclictest22286-21kworker/0:010:50:130
248639965,0cyclictest0-21swapper/308:00:153
248639964,1cyclictest684-21polkitd07:29:553
248639963,2cyclictest17299-21snmpd08:26:253
248639960,5cyclictest0-21swapper/308:58:253
248639960,5cyclictest0-21swapper/308:08:253
248569964,1cyclictest33-21ksoftirqd/209:10:002
248569960,5cyclictest0-21swapper/207:31:482
248529965,0cyclictest0-21swapper/107:12:121
248529964,1cyclictest646-21dbus-daemon07:55:001
248529963,2cyclictest648-21systemd-logind08:50:001
248529963,2cyclictest17299-21snmpd07:24:311
248529960,0cyclictest0-21swapper/108:21:131
248469965,0cyclictest0-21swapper/008:00:270
248469964,1cyclictest684-21polkitd09:09:550
248469963,2cyclictest17299-21snmpd08:15:340
248469963,2cyclictest17299-21snmpd07:43:150
248639953,1cyclictest649-21avahi-daemon07:10:113
248639953,1cyclictest48-17kauditd08:35:443
248639953,1cyclictest3916-21cat07:35:213
248639953,1cyclictest30398-21cat08:40:163
248639953,1cyclictest17299-21snmpd08:32:233
248639953,1cyclictest17299-21snmpd08:10:223
248639953,1cyclictest17299-21snmpd07:46:553
248639953,1cyclictest17299-21snmpd07:18:193
248639953,1cyclictest12047-21cat07:55:163
248639953,1cyclictest1053-21lldpd07:21:523
248569953,1cyclictest33-21ksoftirqd/207:20:002
248569953,1cyclictest29663-21/usr/sbin/munin07:20:142
248569953,1cyclictest26288-21cat08:30:142
248569953,1cyclictest17299-21snmpd08:51:322
248569953,1cyclictest17299-21snmpd08:25:042
248569953,1cyclictest17299-21snmpd08:20:352
248569953,1cyclictest17299-21snmpd08:06:102
248569953,1cyclictest17299-21snmpd07:51:072
248569953,1cyclictest17299-21snmpd07:39:062
248569953,1cyclictest15059-21run-parts08:00:592
248569953,1cyclictest1058-21sendmail09:00:242
248569953,1cyclictest1058-21sendmail08:45:132
248569953,1cyclictest1058-21sendmail07:14:092
248569952,2cyclictest17299-21snmpd07:43:512
248569950,4cyclictest0-21swapper/208:58:072
248569950,4cyclictest0-21swapper/208:35:082
248569950,4cyclictest0-21swapper/207:45:582
248569950,0cyclictest0-21swapper/207:58:082
248529954,0cyclictest0-21swapper/107:45:541
248529953,1cyclictest3881-21cat07:35:211
248529953,1cyclictest30304-21hwlatdetect08:40:161
248529953,1cyclictest26759-21pmu-power08:30:211
248529953,1cyclictest17299-21snmpd08:35:451
248529953,1cyclictest17299-21snmpd08:27:281
248529953,1cyclictest17299-21snmpd08:15:581
248529953,1cyclictest17299-21snmpd08:06:461
248529953,1cyclictest17299-21snmpd07:55:011
248529953,1cyclictest17299-21snmpd07:40:541
248529953,1cyclictest17299-21snmpd07:30:101
248529953,1cyclictest1058-21sendmail08:48:521
248529952,2cyclictest27993-21tail07:15:131
248529952,2cyclictest14419-21cut08:00:191
248529950,4cyclictest1123-21idleruntime-cro07:30:001
248469953,1cyclictest646-21dbus-daemon07:25:000
248469953,1cyclictest5246-21kworker/0:007:46:040
248469953,1cyclictest30176-21sh08:40:140
248469953,1cyclictest17299-21snmpd09:00:360
248469953,1cyclictest17299-21snmpd08:56:560
248469953,1cyclictest17299-21snmpd08:50:030
248469953,1cyclictest17299-21snmpd08:12:050
248469953,1cyclictest17299-21snmpd07:24:580
248469953,1cyclictest17299-21snmpd07:15:030
248469953,1cyclictest1-21systemd08:30:000
248469953,1cyclictest1058-21sendmail08:05:530
248469953,1cyclictest10006-21mii-tool07:50:190
248469952,2cyclictest17299-21snmpd08:39:270
248469952,2cyclictest13139-21taskset07:57:320
248639942,1cyclictest1017-21runrttasks07:50:173
248569942,1cyclictest17878-21cat08:10:112
248469944,0cyclictest26869-21kworker/0:307:35:010
248469942,1cyclictest32086-21cstates08:45:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional