You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-21 - 23:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot6.osadl.org (updated Thu Sep 21, 2023 00:46:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
74551823800,4sleep763-21ksoftirqd/719:05:327
74430523760,7sleep228-21ksoftirqd/219:05:192
7458122127108,3sleep50-21swapper/519:07:085
7445932123106,8sleep40-21swapper/419:05:234
74580129356,11sleep30-21swapper/319:06:593
9143612890,0sleep010-21ksoftirqd/022:35:290
9410202860,0sleep60-21swapper/623:00:186
746227998615,39cyclictest0-21swapper/219:22:432
746227998517,36cyclictest0-21swapper/223:22:432
74583228459,19sleep60-21swapper/619:07:266
746227998314,40cyclictest0-21swapper/221:32:432
74588328056,12sleep00-21swapper/019:08:080
746250997911,35cyclictest0-21swapper/522:02:425
746264997817,35cyclictest0-21swapper/720:57:427
746264997816,34cyclictest0-21swapper/720:32:427
9351592770,2sleep228-21ksoftirqd/222:55:192
9351592770,2sleep228-21ksoftirqd/222:55:182
746264997623,37cyclictest0-21swapper/721:17:427
74574127660,11sleep10-21swapper/119:06:091
8558722720,0sleep40-21swapper/421:45:044
9889362710,0sleep763-21ksoftirqd/723:41:527
9575472710,2sleep574625099cyclictest23:15:075
10529342710,0sleep60-21swapper/600:39:516
8217592690,0sleep50-21swapper/521:15:015
74625099680,36cyclictest0-21swapper/523:37:425
74625099670,37cyclictest0-21swapper/523:47:425
74625099670,37cyclictest0-21swapper/520:22:435
74625099660,36cyclictest0-21swapper/520:42:425
74625099660,35cyclictest0-21swapper/521:52:435
746235996613,22cyclictest0-21swapper/323:57:423
74625099650,43cyclictest49-21ksoftirqd/522:52:425
74625099640,34cyclictest0-21swapper/522:27:435
74625099610,35cyclictest0-21swapper/523:12:425
74624299604,28cyclictest0-21swapper/422:37:424
746214995616,38cyclictest0-21swapper/000:22:420
746214995616,38cyclictest0-21swapper/000:22:420
746242995315,36cyclictest0-21swapper/421:42:424
74625099520,22cyclictest0-21swapper/520:07:425
746242995014,18cyclictest0-21swapper/419:57:424
74625099490,19cyclictest0-21swapper/523:02:435
746242994916,33cyclictest0-21swapper/422:17:424
746242994214,28cyclictest0-21swapper/419:32:434
746258993610,16cyclictest836-21nscd21:57:426
746264993115,15cyclictest0-21swapper/720:02:437
746264993115,15cyclictest0-21swapper/720:02:427
746258992913,15cyclictest0-21swapper/619:37:426
746235992914,15cyclictest0-21swapper/300:32:433
746242992812,15cyclictest0-21swapper/423:27:424
746235992812,15cyclictest0-21swapper/321:07:423
746235992811,16cyclictest0-21swapper/323:17:423
746264992711,15cyclictest0-21swapper/720:12:427
746242992711,4cyclictest0-21swapper/400:27:424
10263072270,0sleep30-21swapper/300:15:213
746258992610,15cyclictest0-21swapper/620:27:436
746258992610,15cyclictest0-21swapper/619:47:426
746250992611,14cyclictest0-21swapper/519:17:435
746235992610,15cyclictest0-21swapper/323:42:423
746214992610,15cyclictest0-21swapper/021:47:420
74624299259,15cyclictest0-21swapper/421:22:424
74624299252,9cyclictest0-21swapper/422:07:424
74621499259,10cyclictest10-21ksoftirqd/023:52:420
74626499248,1cyclictest0-21swapper/722:32:437
74626499248,15cyclictest0-21swapper/722:22:427
74626499248,15cyclictest0-21swapper/700:17:427
8965252230,0sleep50-21swapper/522:20:205
74623599237,15cyclictest0-21swapper/323:07:433
74625899227,15cyclictest0-21swapper/620:37:426
74624299226,15cyclictest0-21swapper/400:37:434
74625099210,1cyclictest0-21swapper/500:12:425
7615362200,1sleep121-21ksoftirqd/119:35:011
74624299204,15cyclictest0-21swapper/400:02:424
74623599204,15cyclictest0-21swapper/322:47:423
10513462200,0sleep70-21swapper/700:37:197
9404262180,0sleep40-21swapper/423:00:004
9404262180,0sleep40-21swapper/423:00:004
8005922180,0sleep20-21swapper/220:40:302
74625099182,15cyclictest0-21swapper/521:27:425
74625099182,15cyclictest0-21swapper/521:27:425
215199170,1rtkit-daemon2150-21rtkit-daemon19:48:297
74625099160,1cyclictest0-21swapper/519:27:425
74623599160,5cyclictest0-21swapper/322:12:423
74623599160,1cyclictest0-21swapper/321:37:433
215199160,1rtkit-daemon818-21earlyoom00:04:207
215199160,1rtkit-daemon2150-21rtkit-daemon21:49:343
746264991513,1cyclictest0-21swapper/719:15:267
215199150,0rtkit-daemon0-21swapper/322:26:363
8980602140,0sleep00-21swapper/022:20:560
7682972140,0sleep40-21swapper/419:45:204
746242991411,2cyclictest1021415-21/usr/sbin/munin00:10:324
74623599145,1cyclictest0-21swapper/320:47:423
74623599140,1cyclictest0-21swapper/321:13:533
746221991413,1cyclictest0-21swapper/123:22:071
746221991413,1cyclictest0-21swapper/100:37:551
74622199140,1cyclictest0-21swapper/100:06:501
74622199140,14cyclictest0-21swapper/122:53:301
74621499140,13cyclictest0-21swapper/023:02:040
215199140,1rtkit-daemon845-21in:imjournal19:52:297
215199140,1rtkit-daemon1245446-21packagekitd23:46:377
746264991313,0cyclictest0-21swapper/723:59:217
746264991313,0cyclictest0-21swapper/719:55:067
74626499130,13cyclictest0-21swapper/723:30:437
74626499130,13cyclictest0-21swapper/722:28:167
74626499130,13cyclictest0-21swapper/721:56:537
74626499130,0cyclictest0-21swapper/722:55:167
74626499130,0cyclictest0-21swapper/722:55:167
74626499130,0cyclictest0-21swapper/722:54:387
74626499130,0cyclictest0-21swapper/721:52:117
74625899130,13cyclictest0-21swapper/623:11:256
74625899130,13cyclictest0-21swapper/622:48:106
74625899130,13cyclictest0-21swapper/600:15:296
74625899130,13cyclictest0-21swapper/600:09:486
74625899130,13cyclictest0-21swapper/600:04:456
74625899130,0cyclictest0-21swapper/622:32:146
74625899130,0cyclictest0-21swapper/621:00:216
746250991313,0cyclictest0-21swapper/523:54:245
74625099130,13cyclictest0-21swapper/522:07:545
74625099130,0cyclictest0-21swapper/523:58:085
74624299130,13cyclictest0-21swapper/423:53:384
74624299130,13cyclictest0-21swapper/423:05:594
74624299130,13cyclictest0-21swapper/422:54:164
74624299130,13cyclictest0-21swapper/420:20:274
746235991312,1cyclictest0-21swapper/323:45:373
746235991312,1cyclictest0-21swapper/321:51:463
746235991312,1cyclictest0-21swapper/321:33:433
746235991312,1cyclictest0-21swapper/319:50:293
74623599130,13cyclictest0-21swapper/323:35:413
74623599130,13cyclictest0-21swapper/322:22:023
74623599130,13cyclictest0-21swapper/320:35:303
74623599130,13cyclictest0-21swapper/300:28:033
74623599130,13cyclictest0-21swapper/300:09:593
74622799130,5cyclictest795592-21systemd-userwor20:35:262
74622799130,1cyclictest0-21swapper/222:54:352
746221991312,1cyclictest0-21swapper/122:10:261
74622199130,13cyclictest0-21swapper/123:43:451
74622199130,13cyclictest0-21swapper/122:21:281
74622199130,13cyclictest0-21swapper/121:46:321
74622199130,13cyclictest0-21swapper/121:33:111
74622199130,13cyclictest0-21swapper/121:01:101
74622199130,13cyclictest0-21swapper/120:00:301
74622199130,13cyclictest0-21swapper/120:00:301
74622199130,13cyclictest0-21swapper/100:34:481
74622199130,0cyclictest0-21swapper/123:02:371
74622199130,0cyclictest0-21swapper/100:18:531
746214991312,1cyclictest0-21swapper/023:49:240
746214991312,1cyclictest0-21swapper/022:54:560
746214991312,1cyclictest0-21swapper/021:27:260
746214991312,1cyclictest0-21swapper/021:27:260
74621499130,13cyclictest0-21swapper/021:36:430
74621499130,13cyclictest0-21swapper/000:00:360
215199130,1rtkit-daemon893117-21ssh22:17:023
215199130,1rtkit-daemon2150-21rtkit-daemon20:09:263
215199130,1rtkit-daemon2150-21rtkit-daemon00:35:033
215199130,0rtkit-daemon0-21swapper/300:07:037
746264991212,0cyclictest0-21swapper/723:54:577
746264991212,0cyclictest0-21swapper/722:08:077
746264991212,0cyclictest0-21swapper/700:28:467
746264991211,1cyclictest0-21swapper/720:20:387
746258991212,0cyclictest0-21swapper/621:52:236
746258991212,0cyclictest0-21swapper/621:41:016
746258991212,0cyclictest0-21swapper/621:33:416
746258991212,0cyclictest0-21swapper/621:23:086
74625899120,12cyclictest0-21swapper/623:36:086
746250991212,0cyclictest0-21swapper/523:44:305
746250991212,0cyclictest0-21swapper/521:55:235
746250991212,0cyclictest0-21swapper/521:20:055
746250991212,0cyclictest0-21swapper/519:45:185
746250991212,0cyclictest0-21swapper/519:35:225
746250991212,0cyclictest0-21swapper/500:29:225
746250991212,0cyclictest0-21swapper/500:07:355
746250991211,1cyclictest861351-21latency_hist21:50:005
74625099120,12cyclictest0-21swapper/522:42:415
74625099120,12cyclictest0-21swapper/519:51:285
746242991212,0cyclictest0-21swapper/423:48:254
746242991212,0cyclictest0-21swapper/423:04:024
746242991210,1cyclictest956956-21ssh23:14:474
746242991210,1cyclictest897285-21grep22:20:274
74624299120,0cyclictest0-21swapper/423:24:024
74624299120,0cyclictest0-21swapper/422:10:434
74624299120,0cyclictest0-21swapper/400:22:254
74624299120,0cyclictest0-21swapper/400:22:244
74624299120,0cyclictest0-21swapper/400:05:304
746235991211,1cyclictest0-21swapper/321:24:283
74623599120,0cyclictest0-21swapper/320:40:333
74622799120,1cyclictest0-21swapper/223:31:592
74622799120,12cyclictest0-21swapper/223:47:162
74622799120,12cyclictest0-21swapper/222:46:582
74622799120,12cyclictest0-21swapper/222:41:152
746221991212,0cyclictest0-21swapper/123:25:521
746221991212,0cyclictest0-21swapper/122:41:191
746221991212,0cyclictest0-21swapper/100:29:171
746221991212,0cyclictest0-21swapper/100:02:271
746221991211,1cyclictest0-21swapper/120:37:351
74622199120,12cyclictest0-21swapper/120:25:321
74622199120,0cyclictest0-21swapper/119:57:251
746214991212,0cyclictest0-21swapper/023:28:260
746214991212,0cyclictest0-21swapper/023:12:190
746214991211,1cyclictest0-21swapper/022:55:340
746214991211,1cyclictest0-21swapper/022:55:340
746214991211,1cyclictest0-21swapper/022:42:050
746214991211,1cyclictest0-21swapper/022:06:370
746214991211,1cyclictest0-21swapper/021:16:140
746214991211,1cyclictest0-21swapper/020:58:110
74621499120,0cyclictest0-21swapper/023:21:350
215199120,1rtkit-daemon882-21gmain19:28:497
215199120,1rtkit-daemon818-21earlyoom20:13:483
215199120,1rtkit-daemon2150-21rtkit-daemon21:13:017
215199120,1rtkit-daemon2150-21rtkit-daemon20:30:123
215199120,1rtkit-daemon2150-21rtkit-daemon19:57:573
215199120,1rtkit-daemon2150-21rtkit-daemon19:34:597
215199120,1rtkit-daemon2091-21gmain23:04:563
215199120,0rtkit-daemon836929-21ssh21:27:283
215199120,0rtkit-daemon836929-21ssh21:27:283
215199120,0rtkit-daemon0-21swapper/323:30:263
215199120,0rtkit-daemon0-21swapper/322:57:363
215199120,0rtkit-daemon0-21swapper/322:57:363
215199120,0rtkit-daemon0-21swapper/319:24:197
103383621211,0sleep10-21swapper/100:21:281
103383621211,0sleep10-21swapper/100:21:281
746264991111,0cyclictest0-21swapper/723:20:487
746264991111,0cyclictest0-21swapper/721:41:277
74625899119,1cyclictest0-21swapper/600:27:516
746258991111,0cyclictest0-21swapper/621:47:016
74625899110,0cyclictest0-21swapper/619:26:236
746250991111,0cyclictest0-21swapper/523:26:365
746250991111,0cyclictest0-21swapper/523:22:525
746250991111,0cyclictest0-21swapper/521:37:585
746250991111,0cyclictest0-21swapper/500:37:595
74625099110,11cyclictest0-21swapper/521:05:475
74625099110,11cyclictest0-21swapper/520:53:365
74625099110,11cyclictest0-21swapper/520:45:185
74625099110,11cyclictest0-21swapper/520:16:125
74624299118,2cyclictest0-21swapper/420:50:244
746242991111,0cyclictest0-21swapper/423:57:234
746242991111,0cyclictest0-21swapper/423:41:164
746242991111,0cyclictest0-21swapper/422:30:044
746242991111,0cyclictest0-21swapper/420:05:304
74624299110,11cyclictest0-21swapper/420:55:154
746235991111,0cyclictest0-21swapper/322:09:393
746235991110,1cyclictest0-21swapper/300:00:333
74623599110,11cyclictest0-21swapper/320:22:503
74623599110,11cyclictest0-21swapper/319:20:433
74623599110,0cyclictest0-21swapper/320:57:483
74623599110,0cyclictest0-21swapper/319:36:483
74623599110,0cyclictest0-21swapper/300:13:183
746227991111,0cyclictest0-21swapper/221:28:052
746227991111,0cyclictest0-21swapper/221:28:052
74622799110,11cyclictest0-21swapper/222:24:112
74622799110,11cyclictest0-21swapper/222:18:302
74622799110,11cyclictest0-21swapper/221:00:562
74622799110,11cyclictest0-21swapper/220:49:242
74622799110,11cyclictest0-21swapper/220:14:362
74622799110,11cyclictest0-21swapper/219:37:312
74622799110,0cyclictest0-21swapper/222:36:532
74622799110,0cyclictest0-21swapper/200:22:352
74622799110,0cyclictest0-21swapper/200:22:342
746221991111,0cyclictest0-21swapper/123:58:041
746221991111,0cyclictest0-21swapper/123:31:241
746221991111,0cyclictest0-21swapper/123:09:461
746221991111,0cyclictest0-21swapper/121:39:511
746221991110,1cyclictest0-21swapper/123:19:021
746221991110,1cyclictest0-21swapper/122:56:071
746221991110,1cyclictest0-21swapper/122:56:061
746221991110,1cyclictest0-21swapper/122:09:471
746221991110,1cyclictest0-21swapper/121:56:361
746221991110,1cyclictest0-21swapper/121:22:361
746221991110,1cyclictest0-21swapper/120:31:531
746221991110,1cyclictest0-21swapper/120:06:401
746221991110,1cyclictest0-21swapper/119:25:511
74622199110,11cyclictest0-21swapper/120:42:361
74622199110,11cyclictest0-21swapper/120:18:321
74622199110,11cyclictest0-21swapper/119:45:031
74622199110,11cyclictest0-21swapper/119:35:081
74622199110,11cyclictest0-21swapper/119:22:071
74622199110,11cyclictest0-21swapper/119:18:231
746214991111,0cyclictest0-21swapper/023:18:290
746214991111,0cyclictest0-21swapper/021:54:450
746214991111,0cyclictest0-21swapper/021:43:220
746214991111,0cyclictest0-21swapper/000:39:090
746214991111,0cyclictest0-21swapper/000:30:320
746214991110,1cyclictest0-21swapper/019:48:250
746214991110,1cyclictest0-21swapper/019:35:240
74621499110,11cyclictest0-21swapper/020:16:530
74621499110,0cyclictest0-21swapper/019:14:540
215199110,0rtkit-daemon2150-21rtkit-daemon23:17:407
215199110,0rtkit-daemon0-21swapper/723:12:023
215199110,0rtkit-daemon0-21swapper/720:29:523
215199110,0rtkit-daemon0-21swapper/719:12:173
215199110,0rtkit-daemon0-21swapper/700:21:353
215199110,0rtkit-daemon0-21swapper/700:21:353
215199110,0rtkit-daemon0-21swapper/323:05:167
215199110,0rtkit-daemon0-21swapper/322:11:057
215199110,0rtkit-daemon0-21swapper/322:01:577
215199110,0rtkit-daemon0-21swapper/321:39:087
215199110,0rtkit-daemon0-21swapper/321:24:247
215199110,0rtkit-daemon0-21swapper/319:38:157
74626499109,1cyclictest0-21swapper/700:10:047
746264991010,0cyclictest0-21swapper/722:16:057
746264991010,0cyclictest0-21swapper/721:27:297
746264991010,0cyclictest0-21swapper/721:27:297
746264991010,0cyclictest0-21swapper/721:04:327
746264991010,0cyclictest0-21swapper/720:44:047
746264991010,0cyclictest0-21swapper/700:20:497
746264991010,0cyclictest0-21swapper/700:20:487
74626499100,0cyclictest0-21swapper/720:51:027
74625899109,1cyclictest0-21swapper/623:30:366
74625899109,1cyclictest0-21swapper/619:57:566
746258991010,0cyclictest0-21swapper/623:46:046
746258991010,0cyclictest0-21swapper/622:20:036
746258991010,0cyclictest0-21swapper/622:12:146
746258991010,0cyclictest0-21swapper/620:48:496
746258991010,0cyclictest0-21swapper/620:43:076
746258991010,0cyclictest0-21swapper/619:54:506
74625899100,0cyclictest0-21swapper/620:09:376
74625099103,3cyclictest906968-21tr22:30:185
746250991010,0cyclictest0-21swapper/522:36:225
746242991010,0cyclictest0-21swapper/423:32:404
746242991010,0cyclictest0-21swapper/423:17:514
746242991010,0cyclictest0-21swapper/421:54:554
746242991010,0cyclictest0-21swapper/421:05:304
746242991010,0cyclictest0-21swapper/420:41:564
746242991010,0cyclictest0-21swapper/420:14:454
746242991010,0cyclictest0-21swapper/419:17:214
746242991010,0cyclictest0-21swapper/400:16:154
74624299100,0cyclictest0-21swapper/421:04:514
74624299100,0cyclictest0-21swapper/419:27:164
74623599108,1cyclictest0-21swapper/322:50:243
746235991010,0cyclictest0-21swapper/321:40:243
74623599100,0cyclictest0-21swapper/320:15:503
74623599100,0cyclictest0-21swapper/319:16:583
746227991010,0cyclictest0-21swapper/223:58:592
746227991010,0cyclictest0-21swapper/223:44:512
746227991010,0cyclictest0-21swapper/221:44:302
746227991010,0cyclictest0-21swapper/221:10:322
746227991010,0cyclictest0-21swapper/220:50:032
746227991010,0cyclictest0-21swapper/220:02:142
746227991010,0cyclictest0-21swapper/220:02:142
746227991010,0cyclictest0-21swapper/219:41:162
746227991010,0cyclictest0-21swapper/219:25:482
74622799100,0cyclictest0-21swapper/221:09:132
74622199109,1cyclictest0-21swapper/123:50:361
74622199109,1cyclictest0-21swapper/123:37:351
74622199109,1cyclictest0-21swapper/121:51:151
74622199109,1cyclictest0-21swapper/119:14:391
74621499109,1cyclictest0-21swapper/022:15:530
74621499109,1cyclictest0-21swapper/000:16:230
746214991010,0cyclictest0-21swapper/023:43:120
746214991010,0cyclictest0-21swapper/023:33:560
746214991010,0cyclictest0-21swapper/020:30:120
746214991010,0cyclictest0-21swapper/020:23:520
74621499100,0cyclictest0-21swapper/021:07:450
215199100,0rtkit-daemon0-21swapper/719:29:243
215199100,0rtkit-daemon0-21swapper/323:10:057
7462649999,0cyclictest0-21swapper/723:28:177
7462649999,0cyclictest0-21swapper/722:39:497
7462649999,0cyclictest0-21swapper/721:46:507
7462589999,0cyclictest0-21swapper/623:56:376
7462589998,1cyclictest0-21swapper/623:08:216
7462589998,1cyclictest0-21swapper/620:32:246
7462589998,1cyclictest0-21swapper/600:10:286
7462509999,0cyclictest0-21swapper/521:43:595
7462509999,0cyclictest0-21swapper/521:19:275
7462509999,0cyclictest0-21swapper/500:03:125
7462509998,1cyclictest748209-21smart_sdb19:10:295
7462509994,1cyclictest0-21swapper/500:17:525
7462429999,0cyclictest0-21swapper/422:44:024
7462429999,0cyclictest0-21swapper/421:34:164
7462429999,0cyclictest0-21swapper/420:26:474
7462359999,0cyclictest0-21swapper/323:20:143
7462359998,1cyclictest1000576-21ssh23:52:253
7462279999,0cyclictest0-21swapper/220:27:552
7462279999,0cyclictest0-21swapper/220:21:352
7462279999,0cyclictest0-21swapper/200:09:342
7462279994,1cyclictest0-21swapper/219:50:272
7462219998,1cyclictest0-21swapper/120:48:571
7462219998,1cyclictest0-21swapper/120:12:511
7462219998,1cyclictest0-21swapper/100:13:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional