You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-11 - 14:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Sun May 11, 2025 12:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
251052218158,47sleep10-21swapper/107:09:261
250722210177,21sleep30-21swapper/307:08:593
248622208153,43sleep00-21swapper/007:06:140
249162199160,26sleep20-21swapper/207:06:572
221662230,0sleep10-21swapper/111:55:201
260262130,0sleep20-21swapper/209:56:392
25261991311,1cyclictest18100-21diskmemload09:59:163
25253991312,1cyclictest28-21ksoftirqd/210:15:182
25243991212,0cyclictest9-21ksoftirqd/010:55:160
25243991211,1cyclictest9-21ksoftirqd/010:25:000
25243991211,1cyclictest9-21ksoftirqd/007:30:010
25253991110,1cyclictest28-21ksoftirqd/207:20:002
25243991111,0cyclictest9-21ksoftirqd/009:20:050
2526199109,1cyclictest35-21ksoftirqd/311:35:003
2525399109,1cyclictest28-21ksoftirqd/210:35:152
2525399109,1cyclictest28-21ksoftirqd/208:44:592
2525399109,1cyclictest28-21ksoftirqd/208:25:012
2525399109,1cyclictest28-21ksoftirqd/207:49:592
2525399109,1cyclictest28-21ksoftirqd/207:45:002
2525399109,1cyclictest28-21ksoftirqd/207:40:012
2525399108,1cyclictest28-21ksoftirqd/212:25:002
2525399108,1cyclictest28-21ksoftirqd/209:15:152
2525399106,1cyclictest28-21ksoftirqd/208:10:002
2525399100,9cyclictest10004-21if_err_eno111:40:192
2525399100,2cyclictest0-21swapper/211:20:362
2524399109,1cyclictest9-21ksoftirqd/011:40:010
2524399109,1cyclictest9-21ksoftirqd/010:30:220
2524399109,1cyclictest9-21ksoftirqd/010:10:000
2524399109,1cyclictest9-21ksoftirqd/008:00:000
2524399109,0cyclictest9-21ksoftirqd/012:15:210
2524399108,1cyclictest9-21ksoftirqd/011:40:170
2524399108,1cyclictest9-21ksoftirqd/009:30:000
2524399103,5cyclictest557-21nscd11:07:360
2524399101,4cyclictest15423-21latency_hist12:30:010
252619997,1cyclictest2033-21fschecks_time08:35:183
252619990,6cyclictest20392-21sh09:10:273
252539998,1cyclictest28-21ksoftirqd/211:20:012
252539998,1cyclictest28-21ksoftirqd/210:35:002
252539998,1cyclictest28-21ksoftirqd/209:20:202
252539997,1cyclictest60950irq/123-eno110:22:532
252539990,5cyclictest0-21swapper/212:25:422
252539990,0cyclictest0-21swapper/212:31:272
252459990,8cyclictest26155-21taskset08:16:021
252459990,0cyclictest0-21swapper/107:55:131
252439998,1cyclictest9-21ksoftirqd/010:45:000
252439998,1cyclictest9-21ksoftirqd/010:00:150
252439990,5cyclictest254-21systemd-journal08:21:430
5285280,0sleep20-21swapper/210:11:022
252619987,1cyclictest35-21ksoftirqd/308:20:013
252619986,1cyclictest26590-21ntpq07:10:203
252619983,3cyclictest18100-21diskmemload10:08:063
252619982,2cyclictest3379-21aten_r1power_po10:10:143
252619982,2cyclictest18100-21diskmemload11:25:143
252619981,6cyclictest5497-21apt-get07:35:133
252619980,6cyclictest27590-21munin-node11:07:393
252619980,6cyclictest18100-21diskmemload12:31:553
252619980,5cyclictest18100-21diskmemload10:25:263
252539988,0cyclictest28-21ksoftirqd/211:45:212
252539988,0cyclictest28-21ksoftirqd/209:10:202
252539987,1cyclictest28-21ksoftirqd/212:09:102
252539987,1cyclictest28-21ksoftirqd/211:50:192
252539987,1cyclictest28-21ksoftirqd/211:35:142
252539987,1cyclictest28-21ksoftirqd/209:50:242
252539987,1cyclictest28-21ksoftirqd/208:45:192
252539987,0cyclictest28-21ksoftirqd/210:45:172
252539986,1cyclictest28-21ksoftirqd/209:40:152
252539986,1cyclictest28-21ksoftirqd/209:35:162
252459981,4cyclictest200-21jbd2/sda2-810:00:061
252439987,1cyclictest9-21ksoftirqd/011:55:160
252439987,1cyclictest9-21ksoftirqd/009:10:010
252439987,1cyclictest9-21ksoftirqd/009:00:010
252439987,1cyclictest9-21ksoftirqd/007:30:130
252439985,2cyclictest557-21nscd10:19:550
252439984,1cyclictest21757-21latency_hist08:10:000
252439981,6cyclictest32682-21ssh10:46:090
252439980,7cyclictest24672-21ssh10:35:400
252439980,7cyclictest21845-21ssh12:36:370
252439980,7cyclictest21707-21ssh09:50:350
252439980,7cyclictest11037-21ssh09:39:090
252439980,7cyclictest0-21swapper/011:45:310
252439980,4cyclictest27383-21perf10:00:010
252619977,0cyclictest35-21ksoftirqd/307:51:023
252619975,1cyclictest29782-21ssh09:22:103
252619975,1cyclictest19552-21ssh12:35:093
252619975,1cyclictest16435-21ssh11:49:333
252619973,2cyclictest18100-21diskmemload10:46:573
252619972,4cyclictest4517-21sh09:30:193
252619971,3cyclictest18855-21rm10:30:123
252619971,2cyclictest18100-21diskmemload09:17:483
252619970,4cyclictest10329-21rm12:21:573
252619970,2cyclictest0-21swapper/310:38:333
252619970,2cyclictest0-21swapper/310:20:163
252619970,1cyclictest254-21systemd-journal08:45:003
252539977,0cyclictest28-21ksoftirqd/211:10:162
252539977,0cyclictest28-21ksoftirqd/210:40:002
252539977,0cyclictest28-21ksoftirqd/210:00:272
252539977,0cyclictest28-21ksoftirqd/208:25:142
252539977,0cyclictest0-21swapper/212:15:062
252539977,0cyclictest0-21swapper/211:58:152
252539976,1cyclictest60950irq/123-eno109:25:412
252539976,1cyclictest28-21ksoftirqd/212:37:472
252539976,1cyclictest28-21ksoftirqd/210:25:192
252539976,1cyclictest28-21ksoftirqd/209:45:212
252539975,1cyclictest60950irq/123-eno111:00:192
252539975,1cyclictest28-21ksoftirqd/209:05:142
252539970,6cyclictest60950irq/123-eno108:18:132
252539970,3cyclictest0-21swapper/210:05:162
252539970,0cyclictest0-21swapper/212:04:032
252459976,1cyclictest0-21swapper/111:42:211
252459972,3cyclictest0-21swapper/112:20:151
252459970,5cyclictest0-21swapper/111:15:241
252439977,0cyclictest9-21ksoftirqd/011:50:180
252439977,0cyclictest9-21ksoftirqd/008:10:150
252439976,1cyclictest9-21ksoftirqd/009:30:160
252439976,1cyclictest9-21ksoftirqd/009:10:030
252439976,1cyclictest9-21ksoftirqd/008:45:230
252439976,1cyclictest9-21ksoftirqd/007:40:000
252439976,1cyclictest9-21ksoftirqd/007:20:210
252439976,1cyclictest17059-21ssh10:26:100
252439975,1cyclictest9-21ksoftirqd/008:30:010
252439974,1cyclictest254-21systemd-journal08:54:430
252439973,3cyclictest564-21nscd08:40:010
252439971,3cyclictest0-21swapper/007:15:130
252439971,2cyclictest18100-21diskmemload12:01:440
252439970,6cyclictest9949-21ssh12:20:550
252439970,6cyclictest651-21ssh11:29:180
252439970,6cyclictest3505-21taskset11:31:340
252439970,6cyclictest30567-21chrt12:05:330
252439970,6cyclictest30124-1kworker/u9:010:10:100
252439970,6cyclictest25837-21ssh11:20:050
252439970,6cyclictest2569-21ssh10:50:170
252439970,6cyclictest25093-21ssh09:16:440
252439970,6cyclictest18100-21diskmemload11:00:190
252439970,6cyclictest13609-21ssh09:40:270
252439970,6cyclictest0-21swapper/011:10:070
252439970,4cyclictest18100-21diskmemload12:10:070
252439970,2cyclictest0-21swapper/007:50:170
25722260,0sleep10-21swapper/109:18:051
252619965,1cyclictest7884-21ssh10:55:383
252619965,1cyclictest30190-21ssh10:44:463
252619965,1cyclictest25079-21ssh11:18:473
252619965,1cyclictest24826-21ssh12:00:123
252619965,1cyclictest23831-21sshd08:11:313
252619965,1cyclictest23090-21ssh11:56:163
252619965,1cyclictest11417-21ssh11:41:473
252619965,1cyclictest10633-21ssh10:19:453
252619965,1cyclictest10284-21ssh09:37:253
252619964,1cyclictest25913-21apt-get11:20:163
252619964,1cyclictest14478-21ssh12:27:383
252619962,3cyclictest26882-21kworker/u8:011:35:163
252619962,2cyclictest4916-21cut12:15:183
252619962,2cyclictest31322chrt07:30:063
252619962,2cyclictest254-21systemd-journal08:56:583
252619961,4cyclictest26764-21kworker/3:112:11:373
252619961,4cyclictest18100-21diskmemload11:52:283
252619961,3cyclictest0-21swapper/307:40:283
252619961,1cyclictest28520-21vmstat08:20:243
252619961,1cyclictest0-21swapper/307:55:133
252619960,4cyclictest0-21swapper/309:45:163
252619960,3cyclictest31491-21apt-get08:30:183
252619960,3cyclictest0-21swapper/310:50:043
252619960,3cyclictest0-21swapper/310:01:453
252619960,3cyclictest0-21swapper/309:40:123
252619960,2cyclictest0-21swapper/311:12:393
252619960,2cyclictest0-21swapper/311:00:133
252619960,2cyclictest0-21swapper/309:54:113
252619960,2cyclictest0-21swapper/309:26:583
252539966,0cyclictest60950irq/123-eno111:30:182
252539966,0cyclictest60950irq/123-eno110:50:092
252539966,0cyclictest60950irq/123-eno109:00:452
252539966,0cyclictest60950irq/123-eno108:57:232
252539966,0cyclictest60950irq/123-eno108:00:092
252539966,0cyclictest60950irq/123-eno107:50:262
252539966,0cyclictest60950irq/123-eno107:30:172
252539966,0cyclictest60950irq/123-eno107:20:082
252539966,0cyclictest28-21ksoftirqd/210:55:152
252539966,0cyclictest28-21ksoftirqd/208:30:192
252539965,1cyclictest60950irq/123-eno107:56:592
252539965,1cyclictest28-21ksoftirqd/212:10:192
252539965,1cyclictest28-21ksoftirqd/211:25:182
252539965,1cyclictest28-21ksoftirqd/211:05:172
252539965,1cyclictest28-21ksoftirqd/208:50:002
252539965,0cyclictest60950irq/123-eno109:32:032
252539964,1cyclictest60950irq/123-eno108:35:182
252539961,3cyclictest2061-21ps07:25:202
252539960,3cyclictest24116-21turbostat.cron08:15:002
252539960,2cyclictest0-21swapper/207:10:162
252459961,2cyclictest0-21swapper/110:15:161
252459961,1cyclictest0-21swapper/112:15:161
252459960,6cyclictest0-21swapper/112:39:261
252459960,6cyclictest0-21swapper/110:41:391
252459960,6cyclictest0-21swapper/110:07:151
252459960,5cyclictest0-21swapper/111:30:491
252459960,4cyclictest0-21swapper/111:24:251
252459960,3cyclictest0-21swapper/109:30:131
252459960,3cyclictest0-21swapper/109:00:181
252459960,2cyclictest0-21swapper/109:50:171
252459960,1cyclictest0-21swapper/110:35:141
252459960,1cyclictest0-21swapper/107:10:131
252439965,1cyclictest9-21ksoftirqd/008:55:170
252439965,1cyclictest21886-21ssh11:15:010
252439961,3cyclictest0-21swapper/012:30:140
252439961,1cyclictest11420-21pmu-power07:45:200
252439960,5cyclictest16427-21ssh09:45:180
252439960,4cyclictest254-21systemd-journal08:34:550
252439960,0cyclictest4882-21strings08:40:240
252439960,0cyclictest0-21swapper/008:15:080
252619955,0cyclictest0-21swapper/308:50:163
252619954,1cyclictest7547-21sensors08:45:233
252619951,2cyclictest0-21swapper/312:05:173
252619951,2cyclictest0-21swapper/307:25:163
252619950,5cyclictest0-21swapper/309:06:533
252619950,2cyclictest0-21swapper/307:20:123
252619950,2cyclictest0-21swapper/307:15:133
252619950,0cyclictest0-21swapper/308:27:353
252459955,0cyclictest0-21swapper/108:51:041
252459955,0cyclictest0-21swapper/107:18:101
252459953,1cyclictest15338-21chrt11:46:391
252459952,1cyclictest0-21swapper/109:25:181
252459951,2cyclictest0-21swapper/109:35:211
252459951,1cyclictest0-21swapper/112:25:231
252459951,1cyclictest0-21swapper/110:27:371
252459950,5cyclictest0-21swapper/112:10:011
252459950,5cyclictest0-21swapper/111:11:551
252459950,5cyclictest0-21swapper/109:40:481
252459950,5cyclictest0-21swapper/108:49:161
252459950,5cyclictest0-21swapper/108:00:171
252459950,4cyclictest0-21swapper/112:14:551
252459950,4cyclictest0-21swapper/109:20:171
252459950,4cyclictest0-21swapper/108:10:131
252459950,3cyclictest0-21swapper/111:29:001
252459950,3cyclictest0-21swapper/109:57:141
252459950,3cyclictest0-21swapper/109:10:451
252459950,2cyclictest0-21swapper/111:05:391
252459950,1cyclictest0-21swapper/112:04:591
252459950,1cyclictest0-21swapper/111:50:011
252459950,1cyclictest0-21swapper/111:35:121
252459950,1cyclictest0-21swapper/110:47:551
252459950,1cyclictest0-21swapper/109:45:231
252459950,1cyclictest0-21swapper/109:05:171
252459950,1cyclictest0-21swapper/108:05:151
252459950,0cyclictest0-21swapper/112:30:131
252459950,0cyclictest0-21swapper/110:20:531
252439951,2cyclictest0-21swapper/007:10:160
252439950,5cyclictest0-21swapper/007:40:210
252439950,4cyclictest17294-21/usr/sbin/munin08:00:220
12820250,0sleep121-21ksoftirqd/111:03:111
252619942,1cyclictest10474-21grep07:45:163
252619941,2cyclictest20237-21tune2fs08:05:143
252619941,2cyclictest13626-21apt-get09:00:163
252619941,1cyclictest17297-21apt-get08:00:133
252459941,1cyclictest0-21swapper/108:40:201
252459941,1cyclictest0-21swapper/108:30:181
252459941,1cyclictest0-21swapper/108:20:221
252459940,4cyclictest0-21swapper/107:32:281
252459940,3cyclictest0-21swapper/107:25:141
252459940,2cyclictest0-21swapper/110:55:071
252459940,2cyclictest0-21swapper/110:30:241
252459940,1cyclictest0-21swapper/110:50:121
252459940,1cyclictest0-21swapper/110:10:171
252459940,1cyclictest0-21swapper/108:55:211
252459940,1cyclictest0-21swapper/107:45:221
252459940,1cyclictest0-21swapper/107:40:241
252459940,1cyclictest0-21swapper/107:35:151
252459940,0cyclictest0-21swapper/107:54:591
252459940,0cyclictest0-21swapper/107:20:451
252459931,1cyclictest0-21swapper/108:25:121
252459930,1cyclictest0-21swapper/108:35:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional