You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-03 - 12:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack8slot0.osadl.org (updated Sun Dec 03, 2023 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1461621320,0sleep214608-21sshd23:40:082
790421260,1sleep27874-21cp00:11:072
1620321180,1sleep01846-21nfsd21:21:090
1428721050,0sleep30-21swapper/322:32:273
1560621040,1sleep3421rcuc/323:17:133
299422800,0sleep029896-21sshd23:22:030
205522760,1sleep120544-21sshd22:24:231
19932760,2sleep1857-21dbus-daemon21:10:441
209592730,1sleep0857-21dbus-daemon22:03:180
310432710,1sleep131044-21sshd22:59:351
251302710,0sleep00-21swapper/022:11:560
224712700,1sleep0141rcuc/023:16:050
21292700,0sleep00-21swapper/021:33:120
6262690,1sleep1623-21sshd21:38:461
161022690,1sleep316100-21sshd21:05:453
161022690,1sleep316100-21sshd21:05:453
116632680,0sleep30-21swapper/321:13:553
54092670,1sleep35408-21sshd23:36:493
41702670,1sleep3421rcuc/322:29:153
41702670,1sleep3421rcuc/322:29:153
279092670,1sleep127875-21bash21:35:451
116982670,0sleep30-21swapper/320:43:293
52432660,0sleep10-21swapper/123:02:441
45322660,0sleep11846-21nfsd21:54:091
327232660,0sleep30-21swapper/323:22:103
31472660,0sleep33115-21sshd20:49:583
267622660,2sleep3865199cyclictest21:00:403
267622660,2sleep3865199cyclictest21:00:403
115152650,1sleep211519-21grepconf.sh21:48:532
281172640,0sleep11845-21nfsd21:59:261
198602640,0sleep1241rcuc/121:46:321
288032630,1sleep2341ktimersoftd/223:58:322
287502630,0sleep10-21swapper/122:16:181
32652620,0sleep33262-21needreboot20:32:273
298152620,0sleep30-21swapper/322:03:413
44382610,1sleep10-21swapper/123:09:411
296682610,0sleep20-21swapper/222:19:112
290692610,0sleep20-21swapper/223:12:112
151102610,0sleep20-21swapper/221:23:522
141982610,0sleep20-21swapper/221:30:572
130192610,0sleep00-21swapper/023:37:100
90722600,0sleep09070-21grep20:57:080
90722600,0sleep09070-21grep20:57:080
112002600,1sleep011202-21grepconf.sh22:42:060
129122590,0sleep0141rcuc/021:16:480
283812580,0sleep30-21swapper/323:51:123
186562580,0sleep318632-21sshd23:53:403
186562580,0sleep318632-21sshd23:53:403
158982580,0sleep30-21swapper/322:01:453
167312570,1sleep31845-21nfsd20:54:393
12042570,0sleep31203-21bash23:02:343
287822560,0sleep20-21swapper/221:18:512
819825527,9sleep10-21swapper/118:39:021
832525426,9sleep00-21swapper/018:40:370
320092540,0sleep30-21swapper/320:27:183
248022540,0sleep01843-21nfsd20:55:000
255612530,0sleep10-21swapper/123:49:341
158802510,0sleep0101ktimersoftd/023:18:340
241522470,1sleep09-21ksoftirqd/023:04:590
233722470,0sleep123356-21bash23:27:251
834224329,8sleep20-21swapper/218:40:512
251072430,0sleep0101ktimersoftd/019:12:050
606324127,8sleep30-21swapper/318:37:033
325552320,0sleep20-21swapper/223:09:302
8641992824,3cyclictest9739-21sshd20:42:051
865199279,3cyclictest44-21ksoftirqd/322:16:483
865199268,3cyclictest44-21ksoftirqd/323:39:583
271552260,0sleep21843-21nfsd23:00:522
97982250,1sleep30-21swapper/322:43:213
865199256,3cyclictest44-21ksoftirqd/321:45:433
8651992511,3cyclictest44-21ksoftirqd/323:12:273
8651992510,3cyclictest44-21ksoftirqd/321:50:283
18552250,1sleep11812-21sshd23:19:231
127612250,0sleep11846-21nfsd20:47:351
865199249,3cyclictest44-21ksoftirqd/321:10:043
865199247,3cyclictest44-21ksoftirqd/300:11:473
865199246,3cyclictest44-21ksoftirqd/322:07:263
54092240,0sleep2331rcuc/222:29:182
54092240,0sleep2331rcuc/222:29:182
865199239,3cyclictest44-21ksoftirqd/323:28:323
865199239,3cyclictest44-21ksoftirqd/322:17:033
865199237,3cyclictest44-21ksoftirqd/321:54:553
865199237,3cyclictest44-21ksoftirqd/321:30:273
865199236,3cyclictest44-21ksoftirqd/323:59:333
8651992310,3cyclictest44-21ksoftirqd/321:26:093
865199230,2cyclictest44-21ksoftirqd/300:06:543
156622230,6sleep00-21swapper/021:40:490
865199227,3cyclictest44-21ksoftirqd/321:36:143
865199226,3cyclictest44-21ksoftirqd/322:51:593
8651992211,3cyclictest44-21ksoftirqd/322:49:133
70342220,1sleep16988-21sshd00:06:371
167842220,0sleep2331rcuc/220:51:572
106452220,1sleep010643-21grepconf.sh22:00:050
865199218,2cyclictest44-21ksoftirqd/321:39:143
865199216,3cyclictest44-21ksoftirqd/323:44:083
865199216,3cyclictest44-21ksoftirqd/322:24:443
865199211,1cyclictest23351-21sshd21:17:153
864199219,3cyclictest26-21ksoftirqd/121:22:491
864199218,1cyclictest26-21ksoftirqd/122:54:251
864199212,2cyclictest26-21ksoftirqd/122:03:381
8641992110,1cyclictest26-21ksoftirqd/123:59:491
8641992110,1cyclictest26-21ksoftirqd/100:07:231
42742210,0sleep20-21swapper/221:38:552
122952210,0sleep00-21swapper/023:51:570
865199209,3cyclictest44-21ksoftirqd/323:07:093
865199200,11cyclictest15927-21sshd22:58:553
864199208,1cyclictest26-21ksoftirqd/123:56:101
864199208,1cyclictest26-21ksoftirqd/123:56:101
864199207,2cyclictest26-21ksoftirqd/122:07:421
864199207,1cyclictest26-21ksoftirqd/121:20:111
864199207,1cyclictest26-21ksoftirqd/121:00:081
864199207,1cyclictest26-21ksoftirqd/121:00:081
320992200,4sleep292050irq/26-p4p1-rx-23:35:032
203482200,1sleep020350-21grepconf.sh22:57:420
865199198,3cyclictest44-21ksoftirqd/322:38:173
864199199,1cyclictest26-21ksoftirqd/121:28:131
864199197,2cyclictest26-21ksoftirqd/120:52:131
8641991917,1cyclictest26-21ksoftirqd/122:33:211
864199190,1cyclictest121rcu_sched22:28:011
864199190,1cyclictest121rcu_sched22:28:011
72452190,0sleep11844-21nfsd21:02:351
72452190,0sleep11844-21nfsd21:02:351
287292190,0sleep0141rcuc/021:07:390
180252190,0sleep018022-21seq23:08:520
165312190,1sleep016508-21sshd22:32:320
12162190,0sleep10-21swapper/122:42:591
8646991815,2cyclictest13550-21sshd21:36:342
864199189,1cyclictest26-21ksoftirqd/123:36:471
864199188,1cyclictest111rcu_preempt23:42:401
864199186,3cyclictest26-21ksoftirqd/122:39:221
864199184,4cyclictest26-21ksoftirqd/122:17:261
8641991816,1cyclictest26-21ksoftirqd/121:13:161
863799180,17cyclictest0-21swapper/021:31:410
172002180,0sleep017203-21bash20:49:110
98502170,0sleep20-21swapper/222:26:452
86812170,0sleep20-21swapper/220:44:442
8646991715,1cyclictest16104-21sshd23:28:302
8646991714,1cyclictest35-21ksoftirqd/223:22:352
864199178,1cyclictest111rcu_preempt23:16:351
864199176,1cyclictest26-21ksoftirqd/122:49:031
864199172,2cyclictest26-21ksoftirqd/121:47:001
864199170,1cyclictest111rcu_preempt23:22:271
8637991714,2cyclictest3251-21bash21:26:130
8552170,1sleep0852-21grepconf.sh22:54:050
137212170,0sleep013720-21grep22:26:550
8646991614,1cyclictest4732-21sshd21:01:082
8646991614,1cyclictest4732-21sshd21:01:082
8646991614,1cyclictest21489-21bash23:49:222
8646991613,2cyclictest16451-21sshd22:43:392
864199165,1cyclictest26-21ksoftirqd/123:40:441
8646991513,1cyclictest92050irq/26-p4p1-rx-22:53:032
8646991513,1cyclictest16872-21sshd21:08:322
8646991512,2cyclictest21762-21sshd23:41:592
8646991512,1cyclictest8297-21sshd22:36:242
8646991511,3cyclictest0-21swapper/220:53:062
8646991511,2cyclictest25965-21sshd21:42:362
864699150,14cyclictest6171-21kworker/2:000:02:592
863799159,5cyclictest0-21swapper/019:09:410
863799153,10cyclictest857-21dbus-daemon23:52:200
863799153,10cyclictest857-21dbus-daemon23:52:200
8637991513,1cyclictest9-21ksoftirqd/021:47:240
8637991513,1cyclictest32426-21sshd00:09:120
48822150,0sleep20-21swapper/221:54:102
864699149,2cyclictest92050irq/26-p4p1-rx-23:51:592
864699149,2cyclictest92050irq/26-p4p1-rx-23:51:592
864699148,0cyclictest0-21swapper/219:12:282
8646991412,1cyclictest4886-21sshd23:18:052
8646991412,1cyclictest14459-21sshd22:38:042
8646991411,2cyclictest17638-21sshd22:14:222
864699140,13cyclictest2733-21sshd21:13:322
864699140,13cyclictest12513-21sshd23:05:532
863799143,10cyclictest511-21jbd2/dm-1-822:19:360
8637991412,1cyclictest9603-21sshd23:34:000
8637991412,1cyclictest9347-21sshd20:44:460
8637991412,1cyclictest879-21systemd-logind22:48:390
8637991412,1cyclictest857-21dbus-daemon21:03:080
8637991412,1cyclictest857-21dbus-daemon21:03:080
8637991412,1cyclictest19445-21sshd21:56:140
863799140,1cyclictest6584-21grepconf.sh00:03:340
8646991311,1cyclictest35-21ksoftirqd/222:07:432
864699130,1cyclictest3090-21fw_conntrack21:02:262
864699130,1cyclictest3090-21fw_conntrack21:02:262
864699130,12cyclictest30701-21missed_timers22:02:202
864699130,12cyclictest23698-21bash22:50:542
864699130,0cyclictest0-21swapper/221:59:002
863799132,1cyclictest19920-21sshd23:30:030
8637991311,1cyclictest25453-21bash21:42:350
8637991311,1cyclictest15674-21sshd23:43:060
864699120,11cyclictest0-21swapper/218:57:272
863799129,1cyclictest10278-21sshd22:12:370
863799122,1cyclictest10771-21sshd22:28:070
863799122,1cyclictest10771-21sshd22:28:070
8637991210,1cyclictest3932-21sshd00:00:250
863799120,10cyclictest9748-21bash22:39:150
865199115,4cyclictest12011-21ntp_offset18:47:013
865199115,3cyclictest44-21ksoftirqd/318:47:003
865199111,9cyclictest44-21ksoftirqd/319:47:253
865199110,9cyclictest0-21swapper/319:02:213
865199110,1cyclictest0-21swapper/319:12:213
865199110,10cyclictest0-21swapper/319:28:083
865199110,10cyclictest0-21swapper/319:28:083
864699119,1cyclictest0-21swapper/219:27:232
864699119,1cyclictest0-21swapper/219:27:232
864699110,1cyclictest0-21swapper/219:32:192
864699110,1cyclictest0-21swapper/219:02:212
864699110,1cyclictest0-21swapper/218:47:002
863799110,2cyclictest11920-21grep18:47:010
865199108,1cyclictest0-21swapper/320:17:203
865199108,1cyclictest0-21swapper/319:42:183
865199102,1cyclictest44-21ksoftirqd/320:16:593
865199100,9cyclictest4594-21awk19:32:233
865199100,9cyclictest0-21swapper/320:10:463
865199100,9cyclictest0-21swapper/319:53:203
865199100,1cyclictest421rcuc/319:07:223
865199100,1cyclictest28222-21diskstats19:17:183
865199100,1cyclictest0-21swapper/319:22:243
864699109,0cyclictest0-21swapper/220:32:332
864699108,1cyclictest23280-21cut19:07:222
864699107,1cyclictest0-21swapper/219:42:192
864699106,3cyclictest6097-21kworker/2:120:02:312
864699105,0cyclictest0-21swapper/220:27:222
864699100,9cyclictest15524-21perl18:52:192
864699100,9cyclictest0-21swapper/220:17:252
864699100,9cyclictest0-21swapper/219:22:272
864699100,1cyclictest24705-21tune2fs20:12:212
864699100,1cyclictest0-21swapper/220:37:252
864699100,0cyclictest0-21swapper/219:58:272
864699100,0cyclictest0-21swapper/219:54:272
864699100,0cyclictest0-21swapper/219:38:392
864199109,0cyclictest0-21swapper/118:50:101
864199108,1cyclictest25627-21diskstats19:12:211
864199100,9cyclictest8853-21df_inode19:42:181
864199100,9cyclictest0-21swapper/120:27:211
864199100,9cyclictest0-21swapper/119:22:241
864199100,9cyclictest0-21swapper/119:07:251
864199100,1cyclictest18226-21hddtemp_smartct18:57:221
864199100,1cyclictest16173-21ntp_states18:52:251
864199100,1cyclictest0-21swapper/119:17:181
864199100,0cyclictest0-21swapper/120:12:321
863799108,1cyclictest3990-21fw_conntrack19:32:190
863799108,1cyclictest10999-21/usr/sbin/munin19:47:190
863799100,9cyclictest24444-21diskstats20:12:200
863799100,9cyclictest0-21swapper/020:36:570
863799100,9cyclictest0-21swapper/019:42:190
863799100,9cyclictest0-21swapper/019:39:270
863799100,9cyclictest0-21swapper/018:52:190
863799100,1cyclictest1958-21grep19:27:280
863799100,1cyclictest1958-21grep19:27:280
863799100,1cyclictest0-21swapper/019:22:280
86519998,0cyclictest0-21swapper/320:06:563
86519998,0cyclictest0-21swapper/318:58:303
86469998,0cyclictest0-21swapper/219:47:082
86469997,1cyclictest0-21swapper/219:17:202
86419998,0cyclictest0-21swapper/119:32:241
86419997,1cyclictest27434-21cat20:17:211
86419990,8cyclictest0-21swapper/119:28:301
86419990,8cyclictest0-21swapper/119:28:301
86419990,0cyclictest0-21swapper/120:41:281
86419990,0cyclictest0-21swapper/119:37:201
86419990,0cyclictest0-21swapper/119:02:211
86379998,0cyclictest0-21swapper/020:38:490
86379998,0cyclictest0-21swapper/020:07:200
86379998,0cyclictest0-21swapper/019:18:460
86379997,1cyclictest30025-21perl20:22:210
86379990,8cyclictest0-21swapper/020:06:240
86379990,0cyclictest0-21swapper/018:44:020
86519987,0cyclictest91950irq/25-em120:26:183
86519982,3cyclictest44-21ksoftirqd/320:41:583
86519982,2cyclictest44-21ksoftirqd/318:52:203
86469985,2cyclictest6097-21kworker/2:120:08:532
86469981,1cyclictest30720-21cut20:22:272
86419987,0cyclictest0-21swapper/119:50:281
86419987,0cyclictest0-21swapper/118:44:141
86379987,0cyclictest0-21swapper/019:01:200
86519970,3cyclictest44-21ksoftirqd/319:57:303
86519970,1cyclictest6433-21cut19:37:203
86469970,1cyclictest0-21swapper/218:42:202
86419970,4cyclictest0-21swapper/120:36:471
86419970,4cyclictest0-21swapper/120:22:011
86419970,4cyclictest0-21swapper/119:58:391
86419970,4cyclictest0-21swapper/119:53:271
86419970,1cyclictest19589-21fw_forwarded_lo20:02:231
86419970,1cyclictest121rcu_sched20:07:351
86379970,6cyclictest0-21swapper/019:02:210
86379970,1cyclictest14051-21df19:52:210
86379970,1cyclictest1022-21runrttasks20:28:210
86379963,2cyclictest17071-21cut19:57:240
86379960,5cyclictest0-21swapper/020:17:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional