You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-15 - 21:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackaslot0.osadl.org (updated Sat Jun 15, 2024 12:44:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2663921100,0sleep126621-21sshd10:12:231
50502880,0sleep30-21swapper/310:31:213
42822870,0sleep30-21swapper/309:41:003
256782700,1sleep11784-21runrttasks09:10:541
64162640,0sleep30-21swapper/311:32:183
145962630,5sleep230-21ksoftirqd/210:43:172
305462590,0sleep20-21swapper/211:03:452
298702580,2sleep22277999cyclictest11:07:012
128922580,0sleep00-21swapper/010:36:010
2107725735,18sleep20-21swapper/207:05:232
89302560,0sleep30-21swapper/309:27:223
238602560,1sleep323859-21bash11:09:583
253052540,1sleep010-21rcuc/009:43:180
69242530,1sleep00-21swapper/010:20:480
185832530,0sleep00-21swapper/012:19:220
122942530,1sleep28-21rcu_preempt09:56:292
108302530,2sleep119-21rcuc/111:36:211
108302530,2sleep119-21rcuc/111:36:201
96222520,0sleep30-21swapper/312:34:483
3772520,1sleep00-21swapper/010:41:460
2242625129,19sleep30-21swapper/307:08:573
2241925130,18sleep10-21swapper/107:08:511
2228025025,20sleep00-21swapper/007:07:040
21942500,0sleep10-21swapper/112:17:311
89352490,1sleep30-21swapper/312:04:393
49992490,0sleep00-21swapper/011:21:570
71122480,1sleep30-21swapper/311:25:323
216732480,0sleep10-21swapper/110:33:141
108552480,1sleep31784-21runrttasks10:57:363
82762470,0sleep00-21swapper/011:04:460
162462470,0sleep016241-21sshd09:10:040
154292470,0sleep115430-21bash11:29:551
274192420,0sleep027417-21sshd11:27:420
206062410,1sleep337-21rcuc/311:45:043
289082400,1sleep128907-21bash11:21:021
192022390,0sleep10-21swapper/109:20:511
119862380,0sleep30-21swapper/310:39:343
296942370,0sleep10-21swapper/109:25:521
252012370,1sleep315523-21diskmemload11:03:053
85932320,0sleep10-21swapper/109:59:451
224402320,1sleep122430-21sshd11:52:081
224402320,1sleep122430-21sshd11:52:071
309892280,0sleep330988-21sshd12:17:093
203392250,0sleep020337-21sshd11:09:350
2277999230,1cyclictest0-21swapper/210:25:192
22777992219,3cyclictest3845-21sshd11:57:080
22778992119,1cyclictest23657-21sshd11:06:191
2277899191,18cyclictest0-21swapper/108:56:251
2277899180,17cyclictest0-21swapper/110:18:351
2278099170,16cyclictest0-21swapper/311:21:073
2277899170,17cyclictest0-21swapper/109:05:051
221782170,1sleep228-21rcuc/210:15:242
190562170,1sleep019054-21sshd09:20:500
81052160,0sleep20-21swapper/212:31:102
22780991615,1cyclictest0-21swapper/310:04:053
22777991610,3cyclictest16975-21sshd10:14:560
4892150,0sleep20-21swapper/211:21:272
288282150,1sleep01784-21runrttasks09:50:550
2278099152,2cyclictest1632-21sshd10:22:513
22780991513,1cyclictest10464-21sshd10:10:333
22780991513,1cyclictest0-21swapper/311:57:093
22779991513,1cyclictest845-21bash09:15:212
22779991513,1cyclictest0-21swapper/210:59:162
22779991512,1cyclictest32696-21sshd11:18:012
2277999150,14cyclictest18775-21sshd12:25:402
2277899159,6cyclictest0-21swapper/108:34:021
2277899155,1cyclictest21-21ksoftirqd/111:30:341
2277899153,1cyclictest21-21ksoftirqd/109:16:561
2277899152,3cyclictest0-21swapper/112:31:311
2277899152,13cyclictest0-21swapper/109:53:271
22778991513,1cyclictest21-21ksoftirqd/111:03:311
22778991512,1cyclictest21-21ksoftirqd/112:37:511
22778991510,5cyclictest0-21swapper/107:22:391
22778991510,5cyclictest0-21swapper/107:12:351
2277899150,1cyclictest0-21swapper/112:26:191
2277899150,15cyclictest0-21swapper/107:40:211
2277899150,14cyclictest0-21swapper/110:04:061
2277799159,3cyclictest0-21swapper/011:51:330
2277799159,3cyclictest0-21swapper/011:51:330
2277799159,3cyclictest0-21swapper/009:37:160
2277799151,11cyclictest0-21swapper/012:10:100
2277799150,11cyclictest0-21swapper/010:05:040
203432150,1sleep120339-21sshd11:45:021
156722150,0sleep10-21swapper/112:22:161
154732150,0sleep215466-21bash10:14:442
23322140,1sleep32322-21sshd09:15:283
2278099149,4cyclictest26940-21sshd09:50:353
2278099149,2cyclictest0-21swapper/309:59:293
22780991412,1cyclictest0-21swapper/311:39:483
22780991412,1cyclictest0-21swapper/311:39:483
2278099140,13cyclictest23648-21munin-node07:10:213
22779991412,1cyclictest31915-21sshd09:51:192
2277999141,12cyclictest0-21swapper/209:33:552
2277899149,5cyclictest0-21swapper/108:46:011
2277899146,8cyclictest21-21ksoftirqd/110:45:371
2277899144,9cyclictest21-21ksoftirqd/110:27:551
2277899143,10cyclictest0-21swapper/107:45:311
2277899142,12cyclictest0-21swapper/108:11:301
22778991412,1cyclictest21-21ksoftirqd/112:00:311
2277899140,14cyclictest0-21swapper/108:51:031
2277899140,13cyclictest28616-21sshd10:51:471
2277899140,13cyclictest0-21swapper/112:14:161
2277799149,4cyclictest0-21swapper/012:23:260
2277799149,2cyclictest0-21swapper/010:55:040
2277799148,5cyclictest0-21swapper/012:34:380
2277799142,1cyclictest0-21swapper/010:52:530
22777991412,1cyclictest7374-21sshd09:34:350
2277799140,3cyclictest0-21swapper/012:36:310
2277799140,3cyclictest0-21swapper/010:15:180
2277799140,13cyclictest0-21swapper/009:25:170
2277799140,13cyclictest0-21swapper/007:15:490
182652140,1sleep218246-21sshd11:37:092
182652140,1sleep218246-21sshd11:37:092
15722140,1sleep21574-21fschecks_time12:00:212
316122130,0sleep10-21swapper/109:40:311
2278099139,1cyclictest0-21swapper/311:53:373
2278099139,1cyclictest0-21swapper/311:53:373
2278099138,4cyclictest0-21swapper/310:05:103
2278099133,1cyclictest16760-21bash10:46:513
2278099132,10cyclictest15523-21diskmemload12:06:183
22780991311,1cyclictest3844-21sshd09:30:283
22780991310,1cyclictest0-21swapper/311:10:213
2278099130,1cyclictest13784-21sshd09:45:383
2278099130,1cyclictest120050irq/25-eth012:28:193
2278099130,12cyclictest21867-21awk10:40:343
2278099130,12cyclictest0-21swapper/312:38:553
2278099130,10cyclictest11264-21sshd11:40:053
2278099130,10cyclictest0-21swapper/309:38:093
2278099130,0cyclictest120050irq/25-eth009:24:503
2277999139,1cyclictest0-21swapper/211:56:552
2277999138,4cyclictest1665-21sshd11:46:242
2277999138,4cyclictest1547-21nfsd10:23:462
2277999138,4cyclictest0-21swapper/212:05:162
2277999138,2cyclictest23440-21sshd11:34:162
2277999138,1cyclictest26022-21sshd12:16:382
2277999131,1cyclictest120050irq/25-eth010:31:472
22779991311,1cyclictest6053-21sshd11:11:272
22779991311,1cyclictest0-21swapper/210:54:372
2277999130,4cyclictest17168-21sshd09:28:272
2277999130,1cyclictest8355-21bash09:41:272
2277999130,12cyclictest29085-21bash09:36:462
2277999130,12cyclictest28677-21bash12:13:322
2277999130,12cyclictest0-21swapper/212:21:542
2277999130,12cyclictest0-21swapper/211:53:262
2277999130,12cyclictest0-21swapper/211:53:262
2277999130,12cyclictest0-21swapper/211:41:122
2277999130,12cyclictest0-21swapper/209:46:502
2277899139,3cyclictest0-21swapper/109:47:141
2277899139,1cyclictest120050irq/25-eth010:20:141
2277899138,2cyclictest0-21swapper/107:19:311
2277899133,9cyclictest21-21ksoftirqd/109:39:311
2277899133,9cyclictest21-21ksoftirqd/109:30:221
2277899132,1cyclictest21-21ksoftirqd/111:16:041
22778991312,1cyclictest21-21ksoftirqd/110:55:231
22778991312,1cyclictest21-21ksoftirqd/110:43:191
2277899131,12cyclictest0-21swapper/108:38:541
2277899130,4cyclictest0-21swapper/112:05:061
2277899130,1cyclictest6030-21sshd11:43:051
2277899130,12cyclictest0-21swapper/111:56:301
2277899130,10cyclictest17892-21sshd10:07:571
2277799139,3cyclictest0-21swapper/012:28:450
2277799138,4cyclictest14664-21bash10:04:090
2277799138,4cyclictest10691-21bash11:47:230
2277799138,2cyclictest0-21swapper/011:44:520
2277799132,10cyclictest29324-21sshd10:26:450
2277799131,1cyclictest14656-21sshd11:36:450
2277799131,1cyclictest14656-21sshd11:36:450
2277799130,3cyclictest32340-21sshd10:30:450
2277799130,1cyclictest0-21swapper/009:46:400
2277799130,12cyclictest9328-21cp09:16:100
2277799130,12cyclictest0-21swapper/012:05:580
2277799130,12cyclictest0-21swapper/011:30:420
2277799130,12cyclictest0-21swapper/011:19:360
2277799130,12cyclictest0-21swapper/010:48:260
2277799130,10cyclictest3428-21sshd12:00:300
2278099129,2cyclictest0-21swapper/312:10:113
2278099129,2cyclictest0-21swapper/310:19:483
2278099129,2cyclictest0-21swapper/309:10:193
2278099128,3cyclictest0-21swapper/312:21:323
2278099128,3cyclictest0-21swapper/310:25:133
2278099120,11cyclictest5132-21ntp_kernel_pll_08:45:213
2278099120,10cyclictest0-21swapper/311:15:153
2277999129,2cyclictest0-21swapper/210:01:152
2277999129,2cyclictest0-21swapper/209:20:172
2277999129,2cyclictest0-21swapper/207:15:032
2277999129,1cyclictest0-21swapper/209:11:242
2277999128,3cyclictest28717-21sshd10:05:332
2277999123,8cyclictest0-21swapper/208:25:412
2277999121,10cyclictest0-21swapper/210:46:122
2277999120,12cyclictest0-21swapper/212:37:342
2277999120,11cyclictest7942-21sshd11:25:362
2277899129,2cyclictest0-21swapper/110:35:141
2277899128,1cyclictest24045-21sshd11:10:001
22778991210,2cyclictest0-21swapper/107:54:201
2277899120,12cyclictest0-21swapper/108:18:361
2277899120,12cyclictest0-21swapper/107:29:551
2277799129,2cyclictest0-21swapper/009:56:000
2277799120,9cyclictest7433-21sshd11:11:340
2278099111,9cyclictest29419-1kworker/3:0H10:50:113
2277999110,11cyclictest0-21swapper/208:21:582
2277999110,11cyclictest0-21swapper/207:40:222
2277999110,10cyclictest0-21swapper/210:35:082
2277999110,10cyclictest0-21swapper/208:55:192
2277899119,2cyclictest0-21swapper/109:01:271
2277899119,2cyclictest0-21swapper/108:09:261
2277899119,2cyclictest0-21swapper/107:33:331
2277899112,5cyclictest0-21swapper/107:56:501
2277899110,11cyclictest0-21swapper/108:02:501
22777991110,1cyclictest8323-21kworker/0:008:40:200
22777991110,1cyclictest0-21swapper/008:19:560
2278099109,1cyclictest0-21swapper/308:40:003
2278099100,1cyclictest0-21swapper/308:17:153
2278099100,10cyclictest0-21swapper/307:59:573
2277999107,2cyclictest32759-21awk07:30:002
2277999100,9cyclictest0-21swapper/208:45:192
2277999100,1cyclictest0-21swapper/209:03:412
2277999100,1cyclictest0-21swapper/208:37:462
2277999100,1cyclictest0-21swapper/208:32:262
2277999100,10cyclictest0-21swapper/208:11:522
2277999100,10cyclictest0-21swapper/208:06:382
2277999100,10cyclictest0-21swapper/208:01:112
2277999100,10cyclictest0-21swapper/207:55:502
2277999100,10cyclictest0-21swapper/207:49:402
2277999100,10cyclictest0-21swapper/207:30:442
2277899108,2cyclictest0-21swapper/108:42:331
2277899103,7cyclictest0-21swapper/107:35:071
2277899100,10cyclictest0-21swapper/108:23:181
2277799100,9cyclictest0-21swapper/007:48:070
227809999,0cyclictest0-21swapper/307:45:123
227809998,1cyclictest0-21swapper/308:22:433
227809998,1cyclictest0-21swapper/308:11:413
227809991,7cyclictest0-21swapper/307:30:303
227809990,9cyclictest0-21swapper/309:07:323
227809990,9cyclictest0-21swapper/308:28:243
227809990,9cyclictest0-21swapper/307:54:083
227809990,8cyclictest0-21swapper/307:20:373
227809990,1cyclictest0-21swapper/308:34:133
227799999,0cyclictest0-21swapper/208:16:522
227799998,1cyclictest0-21swapper/209:07:512
227799998,1cyclictest0-21swapper/208:51:082
227799998,1cyclictest0-21swapper/207:20:382
227789997,2cyclictest0-21swapper/108:28:401
227779998,1cyclictest3-21ksoftirqd/007:59:080
227779997,1cyclictest0-21swapper/009:10:000
227779991,5cyclictest0-21swapper/008:20:370
227779990,1cyclictest0-21swapper/007:33:140
227809987,1cyclictest0-21swapper/309:03:003
227809985,1cyclictest1339-21kworker/3:108:35:193
227809981,6cyclictest0-21swapper/307:35:123
227809980,5cyclictest0-21swapper/307:25:253
227779987,1cyclictest0-21swapper/008:58:290
227779987,1cyclictest0-21swapper/008:30:020
227779982,6cyclictest8323-21kworker/0:008:51:270
227779981,6cyclictest0-21swapper/009:00:180
227779981,6cyclictest0-21swapper/008:45:110
227779981,6cyclictest0-21swapper/008:05:530
227779981,6cyclictest0-21swapper/007:35:230
227779981,6cyclictest0-21swapper/007:20:280
227779980,7cyclictest31344-21fschecks_time07:25:230
227779980,6cyclictest0-21swapper/008:35:160
227779980,5cyclictest0-21swapper/007:10:240
227779980,1cyclictest0-21swapper/008:03:540
227809975,1cyclictest9108-21fschecks_count08:55:173
227809975,1cyclictest6688-21munin-node07:40:273
227809975,1cyclictest25547-21grep07:15:013
227809975,1cyclictest17710-21diskstats08:05:223
227809971,5cyclictest0-21swapper/308:00:103
227809970,6cyclictest0-21swapper/308:50:203
227799975,1cyclictest4283-21cut07:35:272
227799971,5cyclictest0-21swapper/208:40:142
227799970,6cyclictest0-21swapper/207:50:202
227799970,6cyclictest0-21swapper/207:10:182
227779971,5cyclictest0-21swapper/007:54:170
227779971,5cyclictest0-21swapper/007:40:110
227779970,5cyclictest0-21swapper/008:10:240
227779970,4cyclictest0-21swapper/008:30:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional