You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-19 - 06:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Sat Jul 19, 2025 00:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
75122223170,41sleep00-21swapper/019:07:170
74902213177,24sleep30-21swapper/319:07:003
76872211157,21sleep10-21swapper/119:09:361
76062209143,21sleep20-21swapper/219:08:322
19752590,0sleep10-21swapper/100:04:481
115582190,0sleep10-21swapper/121:23:511
184212170,0sleep30-21swapper/300:25:173
780699132,5cyclictest19469-21munin-plugin-st23:45:000
780699130,3cyclictest14952-21apt-get22:55:140
780699130,12cyclictest0-21swapper/023:45:150
780699130,1cyclictest25574-21grep21:40:190
780699130,1cyclictest18268-21switchtime20:35:240
780699130,1cyclictest15755-21sh19:25:000
780699130,0cyclictest664-21diskmemload00:31:110
780699120,2cyclictest0-21swapper/021:12:110
780699120,1cyclictest664-21diskmemload22:44:230
780699120,1cyclictest664-21diskmemload21:24:020
780699120,1cyclictest21273-21gpgv00:30:000
780699120,0cyclictest664-21diskmemload21:57:350
780699120,0cyclictest664-21diskmemload00:10:360
782599119,1cyclictest35-21ksoftirqd/322:15:003
781899110,10cyclictest5604-21snmpd23:53:182
780699119,1cyclictest9-21ksoftirqd/021:33:560
780699119,1cyclictest9-21ksoftirqd/020:20:000
780699112,8cyclictest21307-21apt-get22:20:130
780699111,3cyclictest664-21diskmemload23:20:470
780699111,3cyclictest664-21diskmemload22:52:470
780699111,2cyclictest664-21diskmemload22:29:560
780699111,1cyclictest24468-21chrt23:06:200
780699111,0cyclictest664-21diskmemload22:03:270
780699110,2cyclictest664-21diskmemload23:25:550
780699110,11cyclictest0-21swapper/022:05:090
780699110,10cyclictest32044-21gltestperf21:50:150
780699110,1cyclictest664-21diskmemload23:10:580
780699110,0cyclictest0-21swapper/022:17:070
782599109,1cyclictest35-21ksoftirqd/300:20:003
782599109,1cyclictest35-21ksoftirqd/300:05:003
781899108,1cyclictest28-21ksoftirqd/220:05:002
781899106,3cyclictest60950irq/123-eno122:45:222
781899100,9cyclictest28692-21/usr/sbin/munin22:30:222
780699105,4cyclictest5604-21snmpd20:07:000
780699103,0cyclictest664-21diskmemload21:25:010
780699102,1cyclictest8007-21/usr/sbin/munin19:10:180
780699102,0cyclictest664-21diskmemload23:33:040
780699102,0cyclictest664-21diskmemload00:08:000
780699101,3cyclictest664-21diskmemload22:12:510
780699101,2cyclictest254-21systemd-journal20:00:000
780699100,9cyclictest7396-21ssh21:18:190
780699100,9cyclictest16118-21ssh00:21:450
780699100,6cyclictest30237-21ssh23:58:360
780699100,3cyclictest664-21diskmemload00:38:120
780699100,0cyclictest664-21diskmemload22:33:060
78259998,1cyclictest35-21ksoftirqd/322:35:173
78259997,1cyclictest35-21ksoftirqd/323:20:003
78259997,1cyclictest35-21ksoftirqd/322:35:003
78189998,1cyclictest28-21ksoftirqd/221:18:292
78189995,3cyclictest664-21diskmemload22:20:222
78129990,8cyclictest0-21swapper/123:45:151
78069994,4cyclictest27601-21ssh21:45:090
78069993,0cyclictest664-21diskmemload23:04:260
78069992,1cyclictest8747-21rm22:45:190
78069990,4cyclictest26016-21latency_hist20:55:000
78069990,4cyclictest0-21swapper/023:35:140
78069990,3cyclictest664-21diskmemload23:15:480
78069990,3cyclictest0-21swapper/000:15:400
78069990,2cyclictest254-21systemd-journal19:55:000
78069990,1cyclictest254-21systemd-journal19:35:000
78069990,1cyclictest0-21swapper/019:45:130
78259987,1cyclictest557-21nscd21:14:503
78259986,1cyclictest5604-21snmpd23:50:543
78259986,1cyclictest5604-21snmpd23:14:263
78259986,1cyclictest5604-21snmpd21:26:323
78259986,1cyclictest5604-21snmpd21:02:583
78259986,1cyclictest5604-21snmpd20:38:483
78259986,1cyclictest5604-21snmpd19:17:283
78259986,1cyclictest5604-21snmpd00:07:163
78259986,1cyclictest35-21ksoftirqd/320:10:003
78259986,1cyclictest35-21ksoftirqd/319:29:523
78259981,3cyclictest20127-21apt-get21:35:143
78259980,7cyclictest0-21swapper/322:57:353
78259980,4cyclictest664-21diskmemload00:20:193
78259980,2cyclictest0-21swapper/323:25:123
78189987,1cyclictest28-21ksoftirqd/219:15:012
78189986,1cyclictest60950irq/123-eno122:25:192
78189986,1cyclictest60950irq/123-eno121:50:182
78189986,1cyclictest60950irq/123-eno121:39:552
78189986,1cyclictest60950irq/123-eno121:20:202
78189986,1cyclictest60950irq/123-eno120:30:142
78189986,1cyclictest60950irq/123-eno119:10:152
78189983,2cyclictest254-21systemd-journal23:15:002
78189980,6cyclictest0-21swapper/200:18:142
78189980,0cyclictest0-21swapper/223:00:342
78129988,0cyclictest0-21swapper/119:12:251
78069987,1cyclictest0-21swapper/000:00:210
78069980,8cyclictest0-21swapper/023:51:180
78069980,7cyclictest0-21swapper/021:35:220
78069980,4cyclictest4992-21/usr/sbin/munin20:10:150
78069980,4cyclictest26239-21/usr/sbin/munin20:55:220
78069980,4cyclictest19173-21/usr/sbin/munin20:40:220
78069980,4cyclictest0-21swapper/022:37:230
78069980,1cyclictest254-21systemd-journal21:05:000
78069980,1cyclictest254-21systemd-journal20:35:000
78069980,1cyclictest254-21systemd-journal20:25:000
78069980,1cyclictest254-21systemd-journal20:04:550
78069980,1cyclictest254-21systemd-journal19:44:550
78259976,1cyclictest5604-21snmpd19:44:053
78259976,1cyclictest35-21ksoftirqd/321:20:153
78259976,1cyclictest35-21ksoftirqd/320:00:003
78259975,1cyclictest8887-21cat19:10:163
78259975,1cyclictest6211-21ssh22:00:013
78259975,1cyclictest5604-21snmpd23:55:013
78259975,1cyclictest5604-21snmpd23:02:293
78259975,1cyclictest5604-21snmpd22:45:283
78259975,1cyclictest5604-21snmpd22:24:013
78259975,1cyclictest5604-21snmpd22:05:333
78259975,1cyclictest5604-21snmpd21:51:423
78259975,1cyclictest5604-21snmpd20:34:453
78259975,1cyclictest5604-21snmpd20:14:333
78259975,1cyclictest5604-21snmpd19:21:043
78259975,1cyclictest31025-21latency_hist21:50:003
78259975,1cyclictest27141-21ssh21:44:283
78259975,1cyclictest22414-21cat00:30:173
78259974,1cyclictest664-21diskmemload23:35:093
78259972,1cyclictest664-21diskmemload22:28:543
78259971,4cyclictest0-21swapper/323:47:513
78259971,2cyclictest4690-21sh21:56:213
78259971,2cyclictest11235-21/usr/sbin/munin22:50:193
78259970,6cyclictest664-21diskmemload22:17:033
78259970,6cyclictest0-21swapper/323:40:493
78259970,2cyclictest0-21swapper/322:40:133
78189977,0cyclictest28-21ksoftirqd/200:05:002
78189976,1cyclictest60950irq/123-eno123:45:252
78189976,1cyclictest60950irq/123-eno123:05:152
78189976,1cyclictest60950irq/123-eno122:55:522
78189976,1cyclictest60950irq/123-eno122:10:162
78189976,1cyclictest60950irq/123-eno121:26:432
78189976,1cyclictest60950irq/123-eno100:34:202
78189976,1cyclictest60950irq/123-eno100:03:032
78189976,1cyclictest26480-21sed00:35:182
78189975,1cyclictest60950irq/123-eno122:35:152
78189975,1cyclictest60950irq/123-eno122:15:202
78189975,1cyclictest60950irq/123-eno121:40:122
78189975,1cyclictest60950irq/123-eno100:20:122
78189975,1cyclictest5604-21snmpd23:26:332
78189975,1cyclictest5604-21snmpd21:10:382
78189975,1cyclictest29775-21ssh21:46:262
78189975,1cyclictest1449-21ntpd22:05:022
78189973,2cyclictest570-21systemd-logind00:14:092
78189971,6cyclictest0-21swapper/220:28:122
78189970,6cyclictest0-21swapper/223:30:072
78189970,5cyclictest0-21swapper/223:23:322
78189970,4cyclictest546-21irqbalance23:43:262
78129977,0cyclictest0-21swapper/123:50:141
78129972,1cyclictest0-21swapper/119:39:041
78129970,7cyclictest0-21swapper/123:30:171
78129970,7cyclictest0-21swapper/122:45:501
78129970,7cyclictest0-21swapper/122:43:421
78129970,7cyclictest0-21swapper/122:10:061
78129970,7cyclictest0-21swapper/121:48:041
78129970,6cyclictest0-21swapper/120:12:361
78129970,6cyclictest0-21swapper/119:50:081
78129970,2cyclictest0-21swapper/122:35:141
78129970,0cyclictest0-21swapper/123:00:461
78069970,4cyclictest0-21swapper/019:18:400
78069970,1cyclictest254-21systemd-journal20:30:000
78069970,1cyclictest0-21swapper/020:45:120
78069970,0cyclictest0-21swapper/019:25:130
78259966,0cyclictest35-21ksoftirqd/320:55:163
78259965,1cyclictest27447-21ssh00:35:543
78259965,0cyclictest35-21ksoftirqd/323:30:143
78259964,1cyclictest5604-21snmpd21:30:113
78259964,1cyclictest5604-21snmpd20:22:423
78259964,1cyclictest35-21ksoftirqd/320:50:003
78259962,3cyclictest664-21diskmemload21:15:343
78259962,3cyclictest12094-21apt-get20:25:143
78259962,2cyclictest664-21diskmemload23:20:583
78259961,2cyclictest32283-21rt-features21:05:193
78259960,3cyclictest0-21swapper/323:06:443
78259960,3cyclictest0-21swapper/300:10:093
78189966,0cyclictest60950irq/123-eno123:55:112
78189966,0cyclictest60950irq/123-eno123:35:202
78189966,0cyclictest60950irq/123-eno123:15:172
78189966,0cyclictest60950irq/123-eno122:01:292
78189966,0cyclictest60950irq/123-eno121:55:112
78189966,0cyclictest60950irq/123-eno121:05:132
78189966,0cyclictest60950irq/123-eno120:47:502
78189966,0cyclictest60950irq/123-eno119:45:032
78189965,1cyclictest60950irq/123-eno122:50:112
78189965,1cyclictest60950irq/123-eno122:40:182
78189965,0cyclictest60950irq/123-eno100:25:002
78189964,1cyclictest60950irq/123-eno121:30:212
78189964,1cyclictest60950irq/123-eno119:20:252
78189964,1cyclictest20454-21cron19:35:002
78189964,1cyclictest20249-21needreboot20:40:182
78189963,1cyclictest570-21systemd-logind19:55:192
78189961,5cyclictest0-21swapper/219:25:072
78189960,5cyclictest0-21swapper/220:10:132
78189960,4cyclictest0-21swapper/219:40:132
78189960,3cyclictest0-21swapper/219:50:122
78129961,4cyclictest0-21swapper/122:20:061
78129961,3cyclictest0-21swapper/119:25:211
78129960,6cyclictest0-21swapper/123:42:301
78129960,6cyclictest0-21swapper/120:25:211
78129960,6cyclictest0-21swapper/119:58:441
78129960,6cyclictest0-21swapper/119:21:491
78129960,6cyclictest0-21swapper/119:17:551
78129960,6cyclictest0-21swapper/100:36:401
78129960,6cyclictest0-21swapper/100:05:371
78129960,5cyclictest0-21swapper/122:05:201
78129960,5cyclictest0-21swapper/121:15:131
78129960,5cyclictest0-21swapper/120:59:131
78129960,5cyclictest0-21swapper/120:35:191
78129960,4cyclictest0-21swapper/123:17:371
78129960,4cyclictest0-21swapper/122:31:561
78129960,3cyclictest0-21swapper/123:21:581
78129960,3cyclictest0-21swapper/121:55:151
78129960,2cyclictest0-21swapper/123:55:011
78129960,2cyclictest0-21swapper/120:20:111
78129960,2cyclictest0-21swapper/100:30:211
78129960,2cyclictest0-21swapper/100:15:531
78129960,1cyclictest0-21swapper/121:40:161
78069960,0cyclictest0-21swapper/021:05:520
78069960,0cyclictest0-21swapper/019:37:200
78259955,0cyclictest35-21ksoftirqd/319:30:133
78259954,1cyclictest35-21ksoftirqd/319:55:003
78259953,1cyclictest25923-21df19:45:133
78259953,1cyclictest21491-21tail19:35:173
78259952,2cyclictest31858-21users19:55:203
78259950,5cyclictest0-21swapper/320:17:123
78259950,0cyclictest0-21swapper/320:42:513
78189955,0cyclictest60950irq/123-eno121:00:042
78189955,0cyclictest60950irq/123-eno120:35:162
78189955,0cyclictest60950irq/123-eno120:08:442
78189955,0cyclictest60950irq/123-eno119:35:142
78189954,1cyclictest60950irq/123-eno120:55:142
78189953,1cyclictest8141-21gltestperf20:15:142
78189953,1cyclictest24610-21grep20:50:192
78189950,3cyclictest0-21swapper/220:20:112
78129955,0cyclictest0-21swapper/121:52:371
78129954,1cyclictest0-21swapper/120:45:191
78129951,2cyclictest0-21swapper/119:50:011
78129950,5cyclictest0-21swapper/122:57:491
78129950,5cyclictest0-21swapper/122:00:141
78129950,5cyclictest0-21swapper/121:10:411
78129950,5cyclictest0-21swapper/120:52:221
78129950,5cyclictest0-21swapper/120:06:351
78129950,4cyclictest0-21swapper/123:10:041
78129950,4cyclictest0-21swapper/122:50:141
78129950,4cyclictest0-21swapper/100:10:061
78129950,3cyclictest0-21swapper/122:26:101
78129950,3cyclictest0-21swapper/121:05:001
78129950,2cyclictest0-21swapper/121:36:361
78129950,2cyclictest0-21swapper/100:25:001
78129950,2cyclictest0-21swapper/100:20:191
78129950,1cyclictest0-21swapper/120:30:141
78129950,1cyclictest0-21swapper/120:15:111
78129950,0cyclictest0-21swapper/123:35:251
78129950,0cyclictest0-21swapper/123:26:211
78129950,0cyclictest0-21swapper/123:05:261
78129950,0cyclictest0-21swapper/121:25:451
78259942,1cyclictest23931-21cut20:50:163
78129940,4cyclictest0-21swapper/122:15:341
78129940,1cyclictest0-21swapper/120:40:131
78129940,1cyclictest0-21swapper/120:00:161
78129940,0cyclictest0-21swapper/121:30:301
78129940,0cyclictest0-21swapper/121:08:481
78129940,0cyclictest0-21swapper/119:34:031
78129930,3cyclictest0-21swapper/119:40:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional