You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-24 - 10:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot4.osadl.org (updated Wed Apr 24, 2024 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24801997524,13cyclictest378-21systemd-journal20:11:342
24801997122,14cyclictest27308-21/usr/sbin/munin19:45:132
2480999705,58cyclictest0-21swapper/321:42:253
2480999704,60cyclictest0-21swapper/318:59:583
24809997010,54cyclictest0-21swapper/323:03:103
24801997025,39cyclictest14211-21/usr/sbin/munin19:10:232
2480999699,5cyclictest0-21swapper/323:37:083
2480999697,55cyclictest0-21swapper/322:24:223
2480999695,58cyclictest0-21swapper/322:53:303
2480999694,7cyclictest0-21swapper/320:46:413
2480999694,59cyclictest0-21swapper/321:04:453
2480999694,58cyclictest0-21swapper/322:43:323
2480999694,58cyclictest0-21swapper/322:32:323
2480999694,58cyclictest0-21swapper/320:16:523
2480999694,58cyclictest0-21swapper/320:16:523
24809996912,51cyclictest0-21swapper/320:36:013
24801996923,13cyclictest8585-21/usr/sbin/munin18:55:132
24801996923,13cyclictest8585-21/usr/sbin/munin18:55:132
24801996920,43cyclictest31772-21fschecks_time22:19:582
2480999686,56cyclictest0-21swapper/321:55:093
2480999685,57cyclictest0-21swapper/323:15:033
2480999685,57cyclictest0-21swapper/323:15:033
2480999685,57cyclictest0-21swapper/320:21:263
2480999684,7cyclictest0-21swapper/320:33:293
2480999684,7cyclictest0-21swapper/320:26:593
2480999684,58cyclictest0-21swapper/320:51:483
24801996825,37cyclictest6920-21awk22:30:102
24801996825,37cyclictest27262-21/usr/sbin/munin18:15:142
24801996819,42cyclictest10489-21munin-run23:24:412
24801996819,42cyclictest10489-21munin-run23:24:412
2480999675,6cyclictest0-21swapper/322:09:593
2480999675,56cyclictest0-21swapper/323:14:053
2480999675,55cyclictest0-21swapper/321:09:223
2480999674,7cyclictest0-21swapper/323:31:063
2480999674,7cyclictest0-21swapper/321:21:333
2480999674,57cyclictest0-21swapper/321:34:243
2480999674,57cyclictest0-21swapper/321:15:403
24801996725,36cyclictest1108-21/usr/sbin/munin18:35:202
24801996724,37cyclictest29178-21/usr/sbin/munin19:50:102
24801996717,44cyclictest4070-21diskmemload20:40:362
2480999664,7cyclictest0-21swapper/322:25:553
2480999663,5cyclictest0-21swapper/323:20:263
2480999663,5cyclictest0-21swapper/323:20:263
2480999662,58cyclictest28541-21ssh22:15:053
24801996625,35cyclictest378-21systemd-journal18:47:112
24801996625,35cyclictest21910-21/usr/sbin/munin20:35:112
24801996622,37cyclictest3338-21ntp_kernel_err22:25:052
2480999658,51cyclictest0-21swapper/323:25:073
2480999655,54cyclictest0-21swapper/322:37:593
2480999654,54cyclictest0-21swapper/322:09:103
2480999652,6cyclictest25184-21ssh22:55:213
24801996523,37cyclictest464-21/usr/sbin/munin20:00:122
24801996523,36cyclictest8088-21ntp_states21:00:092
24801996523,36cyclictest32556-21/usr/sbin/munin20:50:232
24801996522,37cyclictest4523-21users21:40:212
24801996522,37cyclictest31043-21/usr/sbin/munin19:55:142
24801996521,38cyclictest30601-21taskset20:45:462
24801996517,41cyclictest7697-21kworker/2:120:24:482
2480999648,49cyclictest0-21swapper/323:05:183
2480999644,53cyclictest0-21swapper/321:50:043
2480999644,53cyclictest0-21swapper/321:35:273
24801996424,34cyclictest25396-21/usr/sbin/munin18:10:172
24801996423,36cyclictest6719-21/usr/sbin/munin18:50:152
24801996423,36cyclictest6719-21/usr/sbin/munin18:50:152
24801996423,36cyclictest5249-21runrttasks23:14:592
24801996423,36cyclictest5249-21runrttasks23:14:592
24801996422,37cyclictest10453-21/usr/sbin/munin19:00:212
24801996422,36cyclictest30798-21diskstats23:04:582
24801996422,13cyclictest4070-21diskmemload22:00:102
24801996422,13cyclictest4070-21diskmemload22:00:102
24801996421,37cyclictest3609-21ssh23:12:232
24801996421,37cyclictest25438-21/usr/sbin/munin19:40:122
24801996420,40cyclictest18520-21latency21:15:052
24801996419,40cyclictest20537-21netstat19:25:102
24801996419,40cyclictest15472-21timerandwakeup21:10:152
24801996419,40cyclictest15472-21timerandwakeup21:10:152
24801996416,42cyclictest667-21runrttasks22:51:112
2480999634,9cyclictest0-21swapper/320:59:253
2480999634,53cyclictest0-21swapper/322:45:593
2480999634,52cyclictest0-21swapper/320:44:073
24801996324,33cyclictest18208-21ssh23:36:232
24801996323,35cyclictest9609-21/usr/sbin/munin22:35:092
24801996323,35cyclictest11402-21/usr/sbin/munin20:20:082
24801996322,36cyclictest3947-21fschecks_count20:54:582
24801996322,35cyclictest28071-21runrttasks23:00:072
24801996319,38cyclictest7697-21kworker/2:121:47:262
2480999625,50cyclictest0-21swapper/320:12:213
2480999624,52cyclictest0-21swapper/321:47:583
2480999624,52cyclictest0-21swapper/321:11:083
2480999624,52cyclictest0-21swapper/321:11:083
2480999624,26cyclictest0-21swapper/321:26:113
24801996225,32cyclictest2009-21ssh21:37:422
24801996223,34cyclictest25135-21sh21:24:592
24801996222,34cyclictest30564-21ssh21:31:542
24801996221,9cyclictest11538-21ntp_offset23:25:062
24801996221,35cyclictest30818-21ssh22:18:592
24801996221,35cyclictest21464-21cut21:19:542
24801996219,37cyclictest23752-21ssh22:09:042
24801996218,38cyclictest19908-21latency_hist22:49:442
2480999613,27cyclictest0-21swapper/320:02:573
24801996123,33cyclictest13113-21/usr/sbin/munin22:40:042
24801996123,33cyclictest12984-21ssh21:07:092
24801996122,33cyclictest25411-21ssh22:55:542
24801996122,33cyclictest18396-21/usr/sbin/munin20:30:062
24801996122,33cyclictest10095-21ssh21:49:472
24801996121,34cyclictest8047-21df_inode20:15:002
24801996121,34cyclictest8047-21df_inode20:15:002
24801996022,33cyclictest26094-21ssh22:11:102
24801996022,32cyclictest15374-21ssh23:31:392
24801996022,32cyclictest13676-21ssh21:54:532
2480999593,27cyclictest0-21swapper/318:14:183
2480999593,25cyclictest0-21swapper/319:21:173
24801995921,33cyclictest23557-21/usr/sbin/munin19:35:142
2439025912,17sleep20-21swapper/218:07:542
2480999584,6cyclictest0-21swapper/319:28:403
2480999583,27cyclictest0-21swapper/318:17:203
24801995822,11cyclictest24342-21snmpd18:27:162
24801995821,31cyclictest24342-21snmpd18:42:202
2480999574,47cyclictest0-21swapper/319:17:223
2480999573,25cyclictest0-21swapper/319:43:593
2480999573,24cyclictest0-21swapper/322:03:513
2480999573,24cyclictest0-21swapper/322:03:513
24801995721,31cyclictest24342-21snmpd19:22:272
24801995717,34cyclictest21686-21/usr/sbin/munin19:29:542
2449425711,16sleep30-21swapper/318:09:123
24809995624,8cyclictest30477-21ntpq18:25:063
24801995620,31cyclictest24342-21snmpd20:05:052
2479299554,46cyclictest0-21swapper/122:44:481
24801995417,32cyclictest13958-21taskset19:09:292
24801995417,12cyclictest596-21ksmtuned19:18:312
2479299544,44cyclictest0-21swapper/122:58:401
2479299543,45cyclictest23533-21ssh22:08:311
2479299543,13cyclictest0-21swapper/120:57:151
2480999533,19cyclictest27595-21/usr/sbin/munin19:45:023
24809995221,8cyclictest14959-21grep19:10:133
24809995214,8cyclictest0-21swapper/318:40:063
2479299524,42cyclictest0-21swapper/121:26:351
2479299524,41cyclictest0-21swapper/120:09:071
24792995212,34cyclictest0-21swapper/122:42:531
24792995210,5cyclictest0-21swapper/121:18:451
2479299514,42cyclictest0-21swapper/123:02:451
2479299514,42cyclictest0-21swapper/120:53:561
2479299513,43cyclictest0-21swapper/120:22:261
2480999503,26cyclictest0-21swapper/318:56:263
2480999503,26cyclictest0-21swapper/318:56:263
2479299504,41cyclictest0-21swapper/118:32:191
2479299504,40cyclictest0-21swapper/123:25:291
2479299503,42cyclictest0-21swapper/122:31:331
2479299503,41cyclictest0-21swapper/122:16:491
2479299503,41cyclictest0-21swapper/122:02:041
2479299503,41cyclictest0-21swapper/122:02:041
2479299498,36cyclictest0-21swapper/122:54:021
2479299495,38cyclictest0-21swapper/121:51:481
2479299494,8cyclictest0-21swapper/120:15:361
2479299494,8cyclictest0-21swapper/120:15:361
2479299494,41cyclictest0-21swapper/121:49:241
2479299494,40cyclictest0-21swapper/121:32:201
2479299494,39cyclictest0-21swapper/120:29:121
2479299494,12cyclictest0-21swapper/121:09:581
2479299494,12cyclictest0-21swapper/121:09:581
2479299493,9cyclictest0-21swapper/123:19:521
2479299493,9cyclictest0-21swapper/123:19:521
2479299493,41cyclictest0-21swapper/123:32:121
2479299493,41cyclictest0-21swapper/122:27:031
2479299493,41cyclictest0-21swapper/122:10:401
2479299493,41cyclictest0-21swapper/120:14:261
2479299492,41cyclictest17952-21/usr/sbin/munin19:20:191
2479299492,41cyclictest16954-21kworker/1:223:06:031
2479299492,41cyclictest12514-21diskstats19:05:011
2478899494,37cyclictest0-21swapper/020:40:050
2479299484,39cyclictest0-21swapper/122:20:491
2479299483,9cyclictest0-21swapper/123:36:221
24792994812,30cyclictest0-21swapper/121:57:361
24792994811,5cyclictest0-21swapper/121:41:171
24792994811,32cyclictest4276-21sshd18:40:361
24792994811,31cyclictest0-21swapper/121:36:341
24792994811,31cyclictest0-21swapper/120:41:401
2478899484,38cyclictest0-21swapper/020:33:050
2478899483,40cyclictest0-21swapper/023:20:420
2478899483,40cyclictest0-21swapper/023:20:420
24809994720,6cyclictest5488-21missed_timers18:45:123
2479299474,37cyclictest0-21swapper/123:12:201
2479299474,37cyclictest0-21swapper/122:36:171
2479299474,15cyclictest0-21swapper/120:47:201
2479299474,10cyclictest0-21swapper/118:45:191
2479299473,39cyclictest0-21swapper/123:18:221
2479299473,39cyclictest0-21swapper/123:18:221
24792994710,5cyclictest0-21swapper/120:30:521
2478899475,36cyclictest0-21swapper/020:55:070
2478899473,40cyclictest0-21swapper/019:42:370
2478899473,11cyclictest0-21swapper/018:09:550
2479299464,37cyclictest0-21swapper/121:24:321
2479299464,37cyclictest0-21swapper/121:06:351
2479299464,36cyclictest0-21swapper/121:00:431
2479299464,36cyclictest0-21swapper/120:34:581
2479299463,8cyclictest0-21swapper/119:38:471
24792994611,30cyclictest0-21swapper/119:15:061
2478899467,34cyclictest0-21swapper/020:46:540
2478899465,36cyclictest0-21swapper/023:25:350
2478899464,37cyclictest0-21swapper/021:04:450
2478899464,36cyclictest0-21swapper/023:03:140
2478899464,36cyclictest0-21swapper/022:26:100
2478899464,36cyclictest0-21swapper/021:58:030
2478899464,36cyclictest0-21swapper/020:38:570
2478899464,10cyclictest0-21swapper/021:35:140
24788994631,11cyclictest0-21swapper/019:19:180
2478899463,7cyclictest0-21swapper/022:30:230
2479299458,32cyclictest682-21sshd18:20:361
2479299453,36cyclictest0-21swapper/118:25:101
2478899455,35cyclictest0-21swapper/023:10:060
2478899454,36cyclictest0-21swapper/022:10:260
2478899454,36cyclictest0-21swapper/021:40:280
2478899454,35cyclictest0-21swapper/023:17:140
2478899454,35cyclictest0-21swapper/023:17:140
2478899454,35cyclictest0-21swapper/023:08:360
2478899454,35cyclictest0-21swapper/020:10:040
2478899453,8cyclictest0-21swapper/021:04:550
2478899453,37cyclictest0-21swapper/021:20:150
2480199445,35cyclictest0-21swapper/218:20:572
2479299445,7cyclictest0-21swapper/118:37:291
2479299443,10cyclictest0-21swapper/118:12:371
2479299442,36cyclictest10238-21munin-run18:59:471
2479299442,36cyclictest10238-21munin-run18:59:471
2478899445,33cyclictest0-21swapper/023:38:030
2478899445,33cyclictest0-21swapper/022:24:310
2478899445,33cyclictest0-21swapper/021:45:230
2478899444,35cyclictest0-21swapper/021:25:220
2478899442,7cyclictest2763-21munin-run18:39:490
2478899442,7cyclictest18384-21awk21:15:020
2480199434,9cyclictest0-21swapper/218:29:552
2479299433,35cyclictest0-21swapper/119:48:331
2478899439,10cyclictest0-21swapper/020:17:240
2478899439,10cyclictest0-21swapper/020:17:240
2478899435,7cyclictest0-21swapper/023:33:370
2478899434,35cyclictest0-21swapper/018:59:570
2427924310,26sleep10-21swapper/118:06:371
2479299424,34cyclictest0-21swapper/119:57:371
2479299423,8cyclictest0-21swapper/119:30:161
2479299423,34cyclictest0-21swapper/119:12:301
2478899425,6cyclictest0-21swapper/019:24:350
141492423,8sleep00-21swapper/020:23:410
2479299414,32cyclictest0-21swapper/119:51:551
2479299413,9cyclictest0-21swapper/119:03:041
2479299413,33cyclictest0-21swapper/118:17:591
2479299412,7cyclictest6719-21/usr/sbin/munin18:50:041
2479299412,7cyclictest6719-21/usr/sbin/munin18:50:041
2478899416,30cyclictest6312-21sshd18:47:350
2478899415,31cyclictest0-21swapper/021:14:120
2478899415,31cyclictest0-21swapper/021:14:120
2478899413,34cyclictest0-21swapper/019:36:280
2478899412,9cyclictest23322-21sshd19:34:350
116612413,7sleep00-21swapper/021:50:350
2479299403,32cyclictest0-21swapper/120:02:401
2478899404,32cyclictest0-21swapper/018:21:530
2478899404,31cyclictest0-21swapper/018:42:360
2478899403,33cyclictest0-21swapper/020:06:300
306842393,7sleep00-21swapper/022:18:400
214582393,7sleep00-21swapper/019:29:410
2479299383,30cyclictest0-21swapper/119:27:421
282552373,7sleep00-21swapper/018:15:200
2478899373,30cyclictest0-21swapper/019:05:310
2452723612,18sleep00-21swapper/018:09:330
286692353,7sleep00-21swapper/019:46:270
2478899354,27cyclictest0-21swapper/021:33:540
2478899354,26cyclictest0-21swapper/018:56:100
2478899354,26cyclictest0-21swapper/018:56:100
2478899353,28cyclictest0-21swapper/022:00:490
2478899353,28cyclictest0-21swapper/022:00:490
24788993525,5cyclictest3-21ksoftirqd/020:50:150
24788993521,8cyclictest20798-21/usr/sbin/munin22:05:210
172612353,7sleep00-21swapper/020:27:440
2478899343,27cyclictest0-21swapper/020:02:080
24809993321,7cyclictest12960-21ls19:05:083
24788993323,7cyclictest10750-21sort22:35:190
24809993222,6cyclictest1847-21tr18:35:153
24809993220,7cyclictest23751-21cut19:35:013
2478899324,24cyclictest0-21swapper/018:29:470
2479299314,23cyclictest0-21swapper/119:44:341
2478899315,21cyclictest0-21swapper/022:44:590
2478899314,24cyclictest0-21swapper/022:44:300
2478899314,24cyclictest0-21swapper/018:31:470
2478899314,22cyclictest0-21swapper/019:54:550
2480999304,21cyclictest0-21swapper/318:20:133
2480999303,22cyclictest0-21swapper/320:04:593
2478899303,22cyclictest15454-21grep19:10:220
2478899303,21cyclictest23833-21wget22:54:540
24788993020,6cyclictest30131-21switchtime19:50:170
24788993018,7cyclictest21463-21sed22:50:170
24809992917,7cyclictest7165-21if_err_eth218:50:063
24809992917,7cyclictest7165-21if_err_eth218:50:063
24809992917,7cyclictest21767-21cut19:29:563
24809992916,8cyclictest560-21NetworkManager19:59:473
24788992917,7cyclictest7976-21users18:50:230
24788992917,7cyclictest7976-21users18:50:230
24809992816,7cyclictest32538-21smart_sda18:30:183
24809992716,7cyclictest29850-21date19:50:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional