You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-26 - 16:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot4.osadl.org (updated Mon Feb 26, 2024 12:43:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
951113995146,3cyclictest1379398-21fwupd12:29:570
95112099234,7cyclictest982821-21tr07:40:192
95111899230,5cyclictest1326212-21munin-run11:54:591
951123992219,2cyclictest1289279-21gltestperf11:30:263
95112099226,5cyclictest1175927-21sh10:15:232
95112099226,5cyclictest0-21swapper/212:05:002
95112099225,5cyclictest1303658-21sed11:40:012
95112099224,6cyclictest1119623-21/usr/sbin/munin09:35:352
95112099224,6cyclictest1025326-21cat08:20:232
95112099224,6cyclictest1014496-21wc08:10:192
951118992217,3cyclictest0-21swapper/110:00:011
95112099215,6cyclictest1183347-21sh10:20:182
95112099215,5cyclictest1009071-21sed08:05:012
95112099215,11cyclictest1128117-21sh09:41:492
95112099214,7cyclictest959051-21cut07:15:262
95112099214,7cyclictest959051-21cut07:15:252
95112099214,6cyclictest1161098-21tune2fs10:05:212
95112099213,7cyclictest1087135-21kthreadcore09:15:262
951118992117,3cyclictest0-21swapper/109:55:011
951118992117,3cyclictest0-21swapper/109:55:001
95112099205,6cyclictest1287499-21sh11:28:072
95112099205,5cyclictest1049437-21tr08:40:252
95112099204,6cyclictest1369565-21ssh12:20:452
95112099204,5cyclictest1310493-21kworker/u8:211:43:552
95112099204,5cyclictest1219337-21sh10:42:262
95112099204,5cyclictest1076703-21diskmemload11:20:462
95112099204,5cyclictest1064513-21cut08:55:302
95112099204,5cyclictest1035263-21/usr/sbin/munin08:30:342
95112099203,6cyclictest1392200-21ssh12:35:362
95112099203,6cyclictest1257007-21ssh11:07:302
95112099203,5cyclictest0-21swapper/211:32:192
95112099202,7cyclictest1148768-21tr09:55:292
95112099202,6cyclictest0-21swapper/211:17:322
951120992010,6cyclictest1076703-21diskmemload11:54:552
951123991916,2cyclictest982488-21idleruntime-cro07:40:003
95112099195,4cyclictest1076703-21diskmemload11:01:462
95112099194,5cyclictest1221281-21expr10:45:212
95112099194,5cyclictest1133620-21cut09:45:272
95112099194,11cyclictest1348493-21sh12:08:362
95112099192,7cyclictest1105729-21ssh09:27:232
95112099192,7cyclictest1009731-21irqcore08:05:222
95112099192,6cyclictest980733-21cut07:35:292
95112099192,6cyclictest1317217-21ssh11:47:202
95112099192,5cyclictest1061205-21sed08:54:592
95112099191,7cyclictest1326902-21fschecks_time11:55:252
951118991915,3cyclictest1104675-21unixbench_multi09:25:351
951118991915,3cyclictest1014154-21cron08:10:001
951118991915,2cyclictest0-21swapper/108:35:011
951113991915,3cyclictest998082-21idleruntime-cro07:55:010
95112099184,4cyclictest1361273-21sh12:15:292
95112099184,4cyclictest1265537-21sh11:14:212
95112099184,4cyclictest1168292-21ssh10:10:142
95112099184,4cyclictest1082062-21sh09:10:542
95112099183,6cyclictest997169-21needreboot07:50:272
95112099183,6cyclictest1354576-21ssh12:10:552
95112099183,5cyclictest1240386-21awk10:55:312
95112099183,5cyclictest1232062-21cut10:50:282
95112099182,7cyclictest1203352-21ssh10:30:532
95112099182,6cyclictest967560-21sed07:25:242
95112099182,6cyclictest1376708-21switchtime12:25:342
95112099182,6cyclictest1143657-21ssh09:52:412
95112099182,6cyclictest1143657-21ssh09:52:402
95112099182,5cyclictest1386354-21ssh12:33:392
95112099182,5cyclictest1193974-21cut10:25:262
95112099182,5cyclictest1158388-21ssh10:01:172
95112099182,5cyclictest1098853-21ssh09:23:382
951118991815,2cyclictest1281014-21sh11:25:001
951113991815,2cyclictest1214123-21irqcore10:40:250
951123991713,3cyclictest1382373-21kthreadcore12:30:293
951123991713,2cyclictest0-21swapper/312:25:003
95112099175,3cyclictest972335-21cpuspeed_turbos07:30:242
95112099174,4cyclictest1044988-21awk08:35:352
95112099174,4cyclictest1021873-21cut08:15:292
95112099174,3cyclictest0-21swapper/207:45:342
95112099174,10cyclictest0-21swapper/207:10:242
951118991714,2cyclictest1093025-21irqcore09:20:251
951118991713,2cyclictest311ktimers/111:25:211
951118991713,2cyclictest0-21swapper/107:40:001
951118991712,3cyclictest0-21swapper/110:55:001
951113991714,2cyclictest956382-21latency_hist07:15:000
951113991714,2cyclictest59150irq/127-enp0s29f1:rx-012:32:170
951113991714,2cyclictest59150irq/127-enp0s29f1:rx-011:15:260
951113991714,2cyclictest59150irq/127-enp0s29f1:rx-011:02:370
951113991714,2cyclictest59150irq/127-enp0s29f1:rx-010:53:590
951113991714,2cyclictest59150irq/127-enp0s29f1:rx-010:46:220
951113991714,2cyclictest59150irq/127-enp0s29f1:rx-010:36:200
951113991714,2cyclictest1311637-21cpuspeed_turbos11:45:180
951113991714,2cyclictest1114725-21idleruntime-cro09:35:000
951113991714,2cyclictest0-21swapper/011:55:000
951113991713,3cyclictest59950irq/128-enp0s29f1:tx-009:20:200
951113991713,3cyclictest1203158-21unixbench_singl10:30:350
95112399164,2cyclictest191rcu_preempt09:25:233
95112399163,2cyclictest191rcu_preempt12:00:233
951123991614,1cyclictest481rcuc/308:15:303
951123991613,2cyclictest1199013-21irqcore10:30:263
951123991613,2cyclictest1055864-21idleruntime-cro08:50:003
951123991613,2cyclictest0-21swapper/311:40:013
951123991612,3cyclictest971186-21nvmesmart_nvme007:25:323
951123991611,3cyclictest0-21swapper/310:40:003
95112099164,4cyclictest1112418-21sh09:30:462
951118991613,2cyclictest519-21in:imuxsock10:10:001
951118991612,3cyclictest987213-21unixbench_multi07:40:311
951118991612,3cyclictest1372363-21cpuspeed_turbos12:25:211
951118991612,2cyclictest1203375-21kworker/u8:0-rpciod11:15:011
951118991612,2cyclictest0-21swapper/110:15:241
951118991611,4cyclictest311ktimers/110:57:581
951118991611,4cyclictest1289492-21sed11:30:281
951118991611,3cyclictest0-21swapper/111:45:001
951113991614,2cyclictest59150irq/127-enp0s29f1:rx-012:10:360
951113991614,2cyclictest59150irq/127-enp0s29f1:rx-011:42:130
951113991614,2cyclictest59150irq/127-enp0s29f1:rx-011:33:230
951113991614,2cyclictest59150irq/127-enp0s29f1:rx-011:08:520
951113991614,2cyclictest59150irq/127-enp0s29f1:rx-009:40:020
951113991614,1cyclictest59950irq/128-enp0s29f1:tx-011:10:030
951113991614,1cyclictest59150irq/127-enp0s29f1:rx-012:38:150
951113991614,1cyclictest59150irq/127-enp0s29f1:rx-010:27:320
951113991613,2cyclictest59950irq/128-enp0s29f1:tx-008:05:230
951113991613,2cyclictest59150irq/127-enp0s29f1:rx-012:21:240
951113991613,2cyclictest59150irq/127-enp0s29f1:rx-012:15:030
951113991613,2cyclictest59150irq/127-enp0s29f1:rx-012:08:160
951113991613,2cyclictest59150irq/127-enp0s29f1:rx-012:02:040
951113991613,2cyclictest59150irq/127-enp0s29f1:rx-010:55:230
951113991613,2cyclictest59150irq/127-enp0s29f1:rx-010:23:410
951113991613,2cyclictest59150irq/127-enp0s29f1:rx-010:19:190
951113991613,2cyclictest59150irq/127-enp0s29f1:rx-010:05:410
951113991613,2cyclictest59150irq/127-enp0s29f1:rx-010:00:020
951113991613,2cyclictest59150irq/127-enp0s29f1:rx-009:50:250
951113991613,2cyclictest59150irq/127-enp0s29f1:rx-009:50:240
951113991613,2cyclictest59150irq/127-enp0s29f1:rx-009:10:310
951113991613,2cyclictest59150irq/127-enp0s29f1:rx-009:00:290
951113991613,2cyclictest59150irq/127-enp0s29f1:rx-008:45:350
95112399153,2cyclictest1076703-21diskmemload09:30:093
951123991512,2cyclictest1218292-21unixbench_singl10:40:353
951123991512,2cyclictest1175997-21cpuspeed_turbos10:15:233
951123991512,2cyclictest1002836-21cut07:55:353
951123991511,3cyclictest962137-21gltestperf07:20:253
95112099153,3cyclictest998645-21cp07:55:012
95112099152,3cyclictest1070446-21sed09:00:252
95112099151,4cyclictest0-21swapper/209:06:302
95111899156,8cyclictest0-21swapper/109:20:001
951118991512,2cyclictest0-21swapper/110:25:001
951118991512,2cyclictest0-21swapper/108:05:011
951118991511,2cyclictest0-21swapper/109:35:251
951113991513,2cyclictest59150irq/127-enp0s29f1:rx-010:10:060
951113991513,2cyclictest59150irq/127-enp0s29f1:rx-009:08:330
951113991513,2cyclictest59150irq/127-enp0s29f1:rx-007:34:580
951113991513,1cyclictest59150irq/127-enp0s29f1:rx-009:15:020
951113991513,1cyclictest59150irq/127-enp0s29f1:rx-008:50:350
951113991512,2cyclictest59950irq/128-enp0s29f1:tx-009:36:380
951113991512,2cyclictest59150irq/127-enp0s29f1:rx-011:55:330
951113991512,2cyclictest59150irq/127-enp0s29f1:rx-011:25:090
951113991512,2cyclictest59150irq/127-enp0s29f1:rx-011:20:290
951113991512,2cyclictest59150irq/127-enp0s29f1:rx-009:58:030
951113991512,2cyclictest59150irq/127-enp0s29f1:rx-009:26:100
951113991512,2cyclictest59150irq/127-enp0s29f1:rx-008:57:060
951113991511,3cyclictest1029791-21sh08:25:010
951113991510,3cyclictest59950irq/128-enp0s29f1:tx-011:35:280
95112399149,3cyclictest1333725-21cron12:00:003
95112399148,5cyclictest1309460-21ssh11:42:013
95112399148,4cyclictest149712-21systemd-journal07:15:003
95112399144,2cyclictest191rcu_preempt10:04:593
95112399141,6cyclictest917867-21kworker/3:0+events09:35:283
951123991412,1cyclictest357-21hwrng10:10:503
951123991411,2cyclictest1372363-21cpuspeed_turbos12:25:213
951123991411,2cyclictest1-21systemd07:55:003
951123991411,2cyclictest1087298-21kthreadcore09:15:263
95112099140,5cyclictest0-21swapper/208:45:552
95111899143,1cyclictest0-21swapper/110:41:281
951118991411,2cyclictest311ktimers/111:19:261
951118991411,2cyclictest1371856-21sh12:25:001
951118991411,2cyclictest1327028-21cut11:55:261
951118991411,2cyclictest1206534-21sed10:35:241
951118991411,2cyclictest1020009-21gltestperf08:15:261
951118991410,3cyclictest989520-21kthreadcore07:45:281
951118991410,3cyclictest1071837-21cpuspeed_turbos09:05:241
951118991410,3cyclictest1061620-21fschecks_time08:55:251
951118991410,3cyclictest1041027-21irqcore08:35:241
951118991410,2cyclictest0-21swapper/112:40:001
951113991412,2cyclictest59150irq/127-enp0s29f1:rx-009:48:440
951113991412,1cyclictest59150irq/127-enp0s29f1:rx-007:55:390
951113991411,2cyclictest956650-21cpuspeed_turbos07:15:200
951113991411,2cyclictest956650-21cpuspeed_turbos07:15:200
951113991411,2cyclictest59150irq/127-enp0s29f1:rx-008:35:250
951113991411,2cyclictest59150irq/127-enp0s29f1:rx-007:45:340
951113991411,2cyclictest59150irq/127-enp0s29f1:rx-007:35:480
951113991411,2cyclictest1050210-21unixbench_multi08:40:310
951113991411,2cyclictest1035792-21irqcore08:30:270
95112399137,4cyclictest1187665-21ntpq10:20:333
95112399134,2cyclictest191rcu_preempt08:35:013
95112399134,2cyclictest191rcu_preempt08:20:223
95112399132,2cyclictest191rcu_preempt10:47:103
95112399132,2cyclictest191rcu_preempt09:50:333
95112399132,2cyclictest191rcu_preempt09:50:323
95112399131,4cyclictest1134160-21kthreadcore09:45:273
95112399131,2cyclictest12437781cpuspeed_turbos11:00:213
95112399131,2cyclictest10801381kthreadcore09:10:253
951123991312,1cyclictest491ktimers/309:59:453
951123991311,1cyclictest1263679-21kworker/u8:2-rpciod11:45:243
951123991311,1cyclictest1071858-21cpuspeed_turbos09:05:233
951123991311,1cyclictest1042237-21kthreadcore08:35:253
951123991310,2cyclictest1203375-21kworker/u8:0-writeback12:10:003
95112399130,4cyclictest1122683-21/usr/sbin/munin09:40:223
95112399130,3cyclictest961667-21wc07:20:013
95112399130,3cyclictest961667-21wc07:20:003
95112399130,3cyclictest191rcu_preempt12:10:203
95111899139,3cyclictest1191165-21fschecks_time10:25:221
95111899139,3cyclictest1067048-21sed09:00:221
95111899139,2cyclictest0-21swapper/111:00:211
95111899139,2cyclictest0-21swapper/110:45:211
95111899139,2cyclictest0-21swapper/108:40:191
95111899138,3cyclictest0-21swapper/108:50:001
95111899137,4cyclictest971973-21cron07:30:001
95111899137,4cyclictest149712-21systemd-journal07:50:551
95111899132,2cyclictest13460022grep12:05:271
951118991310,2cyclictest149712-21systemd-journal07:15:001
951118991310,2cyclictest1384051-21needreboot12:30:311
951118991310,2cyclictest0-21swapper/111:05:281
951113991311,2cyclictest59150irq/127-enp0s29f1:rx-008:18:590
951113991311,1cyclictest1030046-21/usr/sbin/munin08:25:270
951113991310,2cyclictest59150irq/127-enp0s29f1:rx-008:00:240
95112399129,2cyclictest481rcuc/308:50:293
95112399129,2cyclictest1076703-21diskmemload10:25:203
95112399129,1cyclictest0-21swapper/311:10:323
95112399128,3cyclictest1009512-21gltestperf08:05:213
95112399126,4cyclictest1230171-21cut10:50:273
95112399125,5cyclictest1282878-21kthreadcore11:25:283
95112399123,2cyclictest191rcu_preempt11:20:253
951123991210,1cyclictest972238-21/usr/sbin/munin07:30:243
951123991210,1cyclictest1394880-21latency_hist12:40:003
95112399120,2cyclictest191rcu_preempt12:20:003
95112099127,3cyclictest961816-21cat07:20:212
95112099124,6cyclictest951184-21latency_hist07:10:012
95111899129,2cyclictest1034535-21unixbench_multi08:25:351
95111899129,2cyclictest1024941-21cpuspeed_turbos08:20:201
95111899129,2cyclictest0-21swapper/110:30:211
95111899129,2cyclictest0-21swapper/110:00:271
95111899129,2cyclictest0-21swapper/109:10:311
95111899129,2cyclictest0-21swapper/108:15:001
95111899128,2cyclictest0-21swapper/111:45:191
95111899128,2cyclictest0-21swapper/110:10:251
95111899127,4cyclictest311ktimers/112:00:201
95111899126,4cyclictest1350865-21kthreadcore12:10:331
95111899125,6cyclictest1357350-21cut12:15:201
95111899121,10cyclictest961569-21awk07:20:011
95111899121,10cyclictest961569-21awk07:20:001
95111399129,2cyclictest0-21swapper/007:20:270
951113991210,2cyclictest59150irq/127-enp0s29f1:rx-008:10:230
95112399119,1cyclictest1062097-21irqcore08:55:283
95112399119,1cyclictest0-21swapper/308:25:233
95112399118,2cyclictest988081-21cpuspeed_turbos07:45:233
95112399118,2cyclictest1015531-21tr08:10:243
95112399118,2cyclictest0-21swapper/311:10:013
95112399118,1cyclictest0-21swapper/310:55:213
95112399117,3cyclictest491ktimers/310:05:143
95112399116,4cyclictest1-21systemd11:20:013
95112399113,2cyclictest191rcu_preempt08:40:193
95112399112,1cyclictest191rcu_preempt09:20:223
95112399111,2cyclictest13201981kthreadcore11:50:243
95112399110,2cyclictest1009145-21latency_hist08:05:013
95111899118,2cyclictest1130510-21fschecks_time09:45:221
95111899118,2cyclictest0-21swapper/108:50:251
95111899118,2cyclictest0-21swapper/107:25:001
95111899117,3cyclictest1297002-21cut11:35:251
95111899117,2cyclictest0-21swapper/107:30:271
95112399106,3cyclictest1071543-21sed09:05:003
95112399104,5cyclictest983052-21fw_packets07:40:223
95111899104,4cyclictest1001670-21tr07:55:341
9511239997,1cyclictest0-21swapper/307:10:013
9511189991,5cyclictest951042-21latency_hist07:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional