You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-20 - 03:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Fri Apr 19, 2024 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3017299340,33cyclictest0-21swapper/310:30:113
3017299330,32cyclictest0-21swapper/309:17:163
3017299330,29cyclictest22298-21diskmemload11:47:043
3017299330,29cyclictest22298-21diskmemload10:41:523
30172993228,4cyclictest25042-21kworker/u8:212:16:033
30172993227,5cyclictest0-21swapper/310:50:023
3017299320,31cyclictest0-21swapper/312:32:283
3017299320,29cyclictest22298-21diskmemload12:27:273
3017299320,0cyclictest22298-21diskmemload12:21:033
3017299320,0cyclictest22298-21diskmemload10:06:463
3017299320,0cyclictest0-21swapper/312:37:423
3017299320,0cyclictest0-21swapper/309:40:173
3017299320,0cyclictest0-21swapper/309:26:523
3016499320,32cyclictest0-21swapper/110:41:521
3016499320,29cyclictest22298-21diskmemload09:17:151
3016499320,29cyclictest0-21swapper/111:47:041
3016499320,29cyclictest0-21swapper/109:26:511
3016499320,0cyclictest22298-21diskmemload12:37:421
3016499320,0cyclictest0-21swapper/112:30:371
30172993128,3cyclictest22298-21diskmemload12:06:413
30172993128,3cyclictest22298-21diskmemload12:06:413
30172993128,3cyclictest0-21swapper/311:35:003
30172993127,3cyclictest0-21swapper/311:55:273
3017299310,31cyclictest0-21swapper/310:24:583
3017299310,30cyclictest17342-21sh10:15:353
3017299310,29cyclictest0-21swapper/309:33:403
3017299310,0cyclictest0-21swapper/310:29:443
3017299310,0cyclictest0-21swapper/309:45:183
3016899310,30cyclictest26289-21ssh11:01:592
3016899310,30cyclictest21830-21cat12:10:022
3016899310,30cyclictest21830-21cat12:10:022
30164993128,3cyclictest22298-21diskmemload11:25:381
30164993128,2cyclictest0-21swapper/112:16:021
30164993127,3cyclictest14444-21/usr/sbin/munin10:50:011
3016499310,30cyclictest8279-21cron08:40:001
3016499310,30cyclictest5551-21sed11:50:251
3016499310,0cyclictest0-21swapper/112:27:261
3016499310,0cyclictest0-21swapper/112:21:021
3016499310,0cyclictest0-21swapper/110:06:451
3016499310,0cyclictest0-21swapper/109:45:191
3016499310,0cyclictest0-21swapper/109:40:181
30160993129,1cyclictest0-21swapper/012:00:010
30160993128,2cyclictest8019-21latency_hist12:30:000
3016099310,30cyclictest6936-21ssh10:03:510
3016099310,30cyclictest22298-21diskmemload09:50:190
3016099310,30cyclictest21803-21munin-run12:10:010
3016099310,30cyclictest21803-21munin-run12:10:010
3016099310,30cyclictest15492-21ssh10:12:280
30172993028,2cyclictest0-21swapper/311:25:393
30172993023,3cyclictest0-21swapper/310:14:593
3017299300,29cyclictest0-21swapper/311:50:243
3017299300,29cyclictest0-21swapper/310:50:153
3017299300,29cyclictest0-21swapper/310:36:453
3017299300,1cyclictest8283-21cron08:40:013
3017299300,1cyclictest30570-21apt-get09:55:013
3017299300,1cyclictest22298-21diskmemload10:02:013
3017299300,1cyclictest0-21swapper/311:05:173
3017299300,0cyclictest22298-21diskmemload09:12:453
30168993029,1cyclictest7654-21apt-get07:30:102
30168993028,1cyclictest719-21df11:10:112
30168993028,1cyclictest5218-21/usr/sbin/munin12:25:232
30168993028,1cyclictest13425-21ssh09:35:122
30168993028,1cyclictest0-21swapper/209:43:132
30168993027,2cyclictest15080-21ssh12:36:282
3016899300,29cyclictest9976-21apt-get07:35:122
3016899300,29cyclictest561-21dbus-daemon09:00:002
3016899300,29cyclictest32071-21perl12:20:182
3016899300,29cyclictest29048-21ssh09:52:072
3016899300,29cyclictest22298-21diskmemload11:46:482
3016899300,29cyclictest22298-21diskmemload10:04:372
3016899300,29cyclictest15624-21users11:25:232
3016899300,29cyclictest0-21swapper/211:05:102
3016899300,1cyclictest12941-21cron08:50:012
3016899300,1cyclictest0-21swapper/210:50:132
30164993028,2cyclictest0-21swapper/111:30:531
30164993028,1cyclictest0-21swapper/110:20:021
30164993028,1cyclictest0-21swapper/110:15:001
30164993027,2cyclictest0-21swapper/111:55:281
30164993026,3cyclictest0-21swapper/110:31:481
3016499300,30cyclictest22298-21diskmemload09:55:161
3016499300,30cyclictest0-21swapper/112:06:081
3016499300,30cyclictest0-21swapper/112:06:081
3016499300,2cyclictest12011-21diskmemload11:22:051
3016499300,29cyclictest22298-21diskmemload11:42:311
3016499300,29cyclictest13123-21apt-get12:00:131
3016499300,29cyclictest0-21swapper/112:10:041
3016499300,1cyclictest29305-21ntp_states11:05:181
3016499300,1cyclictest22298-21diskmemload09:10:531
3016499300,1cyclictest14740-21apt-get10:50:121
3016499300,0cyclictest0-21swapper/110:29:451
30160993028,1cyclictest0-21swapper/012:00:220
3016099300,2cyclictest31066-21ssh11:07:320
3016099300,29cyclictest26286-21latency_hist12:15:010
3016099300,29cyclictest22298-21diskmemload10:50:450
3016099300,29cyclictest22298-21diskmemload09:26:480
3016099300,29cyclictest0-21swapper/010:46:240
3016099300,29cyclictest0-21swapper/010:35:140
3016099300,29cyclictest0-21swapper/009:55:340
3016099300,1cyclictest58550irq/126-eno111:00:140
3016099300,1cyclictest0-21swapper/011:30:140
30172992928,1cyclictest3868-21apt-get08:30:133
30172992928,1cyclictest0-21swapper/310:55:193
3017299290,29cyclictest22298-21diskmemload11:04:373
3017299290,29cyclictest22298-21diskmemload09:51:233
3017299290,29cyclictest0-21swapper/312:12:343
3017299290,29cyclictest0-21swapper/311:35:343
3017299290,29cyclictest0-21swapper/311:21:103
3017299290,29cyclictest0-21swapper/309:35:553
3017299290,29cyclictest0-21swapper/309:20:453
3017299290,28cyclictest0-21swapper/307:45:103
3017299290,1cyclictest0-21swapper/311:41:293
3017299290,1cyclictest0-21swapper/311:15:113
30168992929,0cyclictest22298-21diskmemload11:30:132
30168992929,0cyclictest0-21swapper/211:51:412
30168992929,0cyclictest0-21swapper/209:11:552
30168992928,1cyclictest22919-21ssh11:35:112
30168992928,1cyclictest0-21swapper/209:25:162
30168992927,1cyclictest31217-21apt-get09:55:112
3016899290,29cyclictest22298-21diskmemload12:32:302
3016899290,29cyclictest22298-21diskmemload12:10:192
3016899290,29cyclictest22298-21diskmemload10:43:452
3016899290,29cyclictest22298-21diskmemload10:16:552
3016899290,29cyclictest22298-21diskmemload10:06:152
3016899290,29cyclictest22298-21diskmemload09:16:012
3016899290,29cyclictest0-21swapper/211:56:292
3016899290,29cyclictest0-21swapper/210:57:522
3016899290,29cyclictest0-21swapper/210:35:162
3016899290,29cyclictest0-21swapper/210:30:152
3016899290,29cyclictest0-21swapper/210:26:072
3016899290,29cyclictest0-21swapper/210:14:412
3016899290,29cyclictest0-21swapper/209:47:282
3016899290,0cyclictest22298-21diskmemload12:17:042
3016899290,0cyclictest22298-21diskmemload12:00:552
3016899290,0cyclictest22298-21diskmemload10:20:572
3016899290,0cyclictest22298-21diskmemload09:20:052
3016899290,0cyclictest0-21swapper/211:20:142
3016899290,0cyclictest0-21swapper/211:17:252
3016899290,0cyclictest0-21swapper/210:45:102
3016499290,29cyclictest22298-21diskmemload10:36:461
3016499290,29cyclictest15050-21apt-get07:45:091
3016499290,29cyclictest0-21swapper/111:35:331
3016499290,29cyclictest0-21swapper/111:03:021
3016499290,29cyclictest0-21swapper/110:56:051
3016499290,29cyclictest0-21swapper/110:15:461
3016499290,29cyclictest0-21swapper/110:01:021
3016499290,29cyclictest0-21swapper/109:35:561
3016499290,29cyclictest0-21swapper/109:20:441
3016499290,1cyclictest0-21swapper/111:15:121
3016499290,0cyclictest22298-21diskmemload11:10:261
3016499290,0cyclictest0-21swapper/109:50:511
30160992929,0cyclictest22298-21diskmemload10:20:040
30160992929,0cyclictest0-21swapper/012:16:260
30160992928,1cyclictest58550irq/126-eno111:25:180
30160992928,1cyclictest14716-21ssh09:35:350
30160992928,1cyclictest0-21swapper/009:16:310
3016099290,29cyclictest22298-21diskmemload12:36:270
3016099290,29cyclictest22298-21diskmemload11:35:370
3016099290,29cyclictest22298-21diskmemload10:25:020
3016099290,29cyclictest0-21swapper/012:30:150
3016099290,29cyclictest0-21swapper/011:51:460
3016099290,29cyclictest0-21swapper/011:40:040
3016099290,29cyclictest0-21swapper/011:15:490
3016099290,29cyclictest0-21swapper/010:43:100
3016099290,29cyclictest0-21swapper/010:18:150
3016099290,29cyclictest0-21swapper/009:46:100
3016099290,29cyclictest0-21swapper/009:21:300
3016099290,29cyclictest0-21swapper/008:40:110
3016099290,0cyclictest22669-21apt-get09:10:100
3016099290,0cyclictest22298-21diskmemload12:22:540
3016099290,0cyclictest22298-21diskmemload11:22:470
3016099290,0cyclictest22298-21diskmemload11:11:450
3016099290,0cyclictest22298-21diskmemload10:57:080
3016099290,0cyclictest22298-21diskmemload10:31:320
3016099290,0cyclictest0-21swapper/011:45:400
30172992828,0cyclictest0-21swapper/307:25:023
3017299280,28cyclictest0-21swapper/308:55:123
3016899280,28cyclictest0-21swapper/209:30:512
3016899280,28cyclictest0-21swapper/207:10:092
3016899280,0cyclictest0-21swapper/207:25:102
30164992828,0cyclictest0-21swapper/107:25:021
30164992828,0cyclictest0-21swapper/107:20:131
3016499280,28cyclictest0-21swapper/108:55:131
30160992828,0cyclictest0-21swapper/007:55:100
3016099280,0cyclictest0-21swapper/009:30:230
30164992727,0cyclictest0-21swapper/108:30:121
30164992725,1cyclictest0-21swapper/107:55:001
30160992726,1cyclictest20259-21apt-get09:05:100
30172992626,0cyclictest12141-21apt-get07:40:013
30172992625,1cyclictest19736-21munin-run07:55:013
30168992626,0cyclictest19993-21apt-get07:55:102
30172992525,0cyclictest0-21swapper/309:00:123
30164992525,0cyclictest0-21swapper/109:00:131
30164992525,0cyclictest0-21swapper/107:40:011
30168992423,1cyclictest584-21gdbus07:50:012
30160992424,0cyclictest0-21swapper/008:15:120
30160992424,0cyclictest0-21swapper/008:05:020
30160992424,0cyclictest0-21swapper/008:05:020
30172992323,0cyclictest0-21swapper/308:15:133
30164992323,0cyclictest29295-21apt-get08:15:121
30160992323,0cyclictest0-21swapper/008:30:120
30172992222,0cyclictest0-21swapper/308:45:133
30172992222,0cyclictest0-21swapper/308:00:143
30172992222,0cyclictest0-21swapper/308:00:143
30172992220,1cyclictest0-21swapper/308:25:013
30168992222,0cyclictest0-21swapper/207:40:112
30164992222,0cyclictest10909-21apt-get08:45:131
30164992222,0cyclictest0-21swapper/108:00:151
30164992222,0cyclictest0-21swapper/108:00:141
30160992222,0cyclictest0-21swapper/008:20:120
30168992121,0cyclictest0-21swapper/208:10:132
30168992119,1cyclictest561-21dbus-daemon08:35:002
30160992121,0cyclictest0-21swapper/007:15:120
30160992119,1cyclictest561-21dbus-daemon07:30:020
30168992020,0cyclictest1547-21apt-get08:25:122
30168992017,2cyclictest2411-21systemd-journal07:20:002
30164992019,1cyclictest1329-21munin-run08:25:001
30168991818,0cyclictest22342-21apt-get08:00:132
30168991818,0cyclictest22342-21apt-get08:00:132
30168991818,0cyclictest13229-21apt-get08:50:122
30172991717,0cyclictest0-21swapper/307:35:123
30172991715,1cyclictest29042-21munin-run08:15:013
30164991717,0cyclictest0-21swapper/107:35:131
30164991614,1cyclictest0-21swapper/108:15:021
3016499160,15cyclictest10632-21perf08:45:011
30160991616,0cyclictest0-21swapper/007:40:000
3016099160,15cyclictest18190-21cstates09:00:130
3016099160,15cyclictest17204-21apt-config07:50:000
30172991515,0cyclictest0-21swapper/307:20:143
3017299150,14cyclictest10651-21munin-run08:45:013
3016499150,15cyclictest26721-21perf08:10:021
3016499150,14cyclictest22081-21munin-run08:00:001
3016099150,1cyclictest18284-21cut07:50:160
3016099150,1cyclictest0-21swapper/008:05:140
3017299140,14cyclictest0-21swapper/309:08:333
3017299140,14cyclictest0-21swapper/308:50:373
3017299140,14cyclictest0-21swapper/308:25:573
3017299140,14cyclictest0-21swapper/308:07:353
3017299140,14cyclictest0-21swapper/307:57:393
3017299140,14cyclictest0-21swapper/307:15:493
3017299140,14cyclictest0-21swapper/307:12:143
3017299140,0cyclictest0-21swapper/307:30:383
3016899140,14cyclictest0-21swapper/209:07:022
3016899140,14cyclictest0-21swapper/209:01:022
3016899140,14cyclictest0-21swapper/208:40:372
3016899140,14cyclictest0-21swapper/208:07:342
3016899140,14cyclictest0-21swapper/207:22:002
3016899140,0cyclictest0-21swapper/208:20:542
3016499140,14cyclictest0-21swapper/109:08:341
3016499140,14cyclictest0-21swapper/108:50:381
3016499140,14cyclictest0-21swapper/108:25:561
3016499140,14cyclictest0-21swapper/107:11:321
3016499140,0cyclictest0-21swapper/107:34:241
3016499140,0cyclictest0-21swapper/107:15:011
30160991414,0cyclictest0-21swapper/008:35:090
30160991414,0cyclictest0-21swapper/007:20:110
3016099140,14cyclictest0-21swapper/008:58:490
3016099140,14cyclictest0-21swapper/008:45:200
3016099140,14cyclictest0-21swapper/008:26:370
3016099140,14cyclictest0-21swapper/008:10:390
3016099140,14cyclictest0-21swapper/007:30:020
3016099140,14cyclictest0-21swapper/007:12:260
3016099140,0cyclictest0-21swapper/008:51:270
3016099140,0cyclictest0-21swapper/007:40:120
30168991313,0cyclictest0-21swapper/207:52:532
3016899130,0cyclictest0-21swapper/208:35:262
30168991212,0cyclictest0-21swapper/208:16:072
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional