You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 07:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot4.osadl.org (updated Sat Nov 29, 2025 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13642998627,53cyclictest4401-21wget13:56:412
13642997417,12cyclictest0-21swapper/217:37:542
13642997417,12cyclictest0-21swapper/217:37:542
13642997121,44cyclictest26464-21/usr/sbin/munin18:01:462
13642997024,40cyclictest14570-21switchtime16:56:552
13642997020,44cyclictest2473-21/usr/sbin/munin13:51:442
13642996922,41cyclictest29650-21basename13:36:462
13642996919,43cyclictest24739-21ssh17:57:572
13642996821,40cyclictest560-21NetworkManager14:46:272
13642996815,47cyclictest13281-21unixbench_multi15:22:002
13642996722,38cyclictest27520-21df_inode13:31:432
13642996721,40cyclictest17471-21/usr/sbin/munin14:32:012
13642996720,41cyclictest9613-21ssh16:51:122
13642996720,41cyclictest29764-21ssh17:19:022
1364299669,51cyclictest21378-21ssh16:21:272
13642996620,40cyclictest667-21runrttasks17:02:442
13642996620,40cyclictest667-21runrttasks17:02:442
13642996620,13cyclictest11849-21/usr/sbin/munin14:16:452
13642996619,40cyclictest13726-21/usr/sbin/munin14:21:442
13642996618,10cyclictest12321-21taskset16:06:582
13642996522,37cyclictest15598-21/usr/sbin/munin14:26:502
13642996423,35cyclictest27602-21chrt15:42:332
13642996423,35cyclictest21436-21/usr/sbin/munin17:06:522
13642996423,35cyclictest19857-21/usr/sbin/munin13:12:022
13642996420,38cyclictest8427-21open_inodes16:01:512
13642996420,38cyclictest25477-21/usr/sbin/munin13:26:432
13642996420,38cyclictest18970-21taskset15:31:312
13642996419,38cyclictest6674-21/usr/sbin/munin17:31:532
13642996419,38cyclictest6221-21/usr/sbin/munin14:01:452
1364299639,48cyclictest0-21swapper/213:46:542
13642996322,35cyclictest32711-21crond15:51:262
13642996322,35cyclictest31012-21ssh16:34:452
13642996322,35cyclictest25212-21df_inode16:26:382
13642996321,37cyclictest24817-21ntp_states17:11:482
13642996320,37cyclictest7166-21/usr/sbin/munin18:21:562
13642996320,37cyclictest31851-21ntp_states17:21:492
13642996320,37cyclictest1992-21ssh15:52:052
13642996318,39cyclictest14753-21fschecks_count16:11:392
13642996222,34cyclictest24979-21/usr/sbin/munin14:51:442
13642996221,35cyclictest9308-21/usr/sbin/munin15:16:502
13642996221,35cyclictest4381-21seq16:41:592
13642996217,10cyclictest19187-21munin-run17:51:232
13642996122,32cyclictest31949-21/usr/sbin/munin16:36:372
13642996121,35cyclictest5313-21ssh18:16:592
13642996121,34cyclictest7339-21sshd15:14:182
13642996120,36cyclictest29356-21ssh14:59:342
13642996119,37cyclictest6287-21ssh15:58:582
13642996119,37cyclictest12061-21ssh16:53:392
13642996117,38cyclictest16094-21latency15:26:462
13642996117,38cyclictest16094-21latency15:26:462
13642996116,39cyclictest0-21swapper/217:29:022
13642996110,44cyclictest30810-21ssh18:06:532
13642996021,34cyclictest16111-21/usr/sbin/munin13:01:452
13642996021,34cyclictest16111-21/usr/sbin/munin13:01:452
13642996021,33cyclictest32064-21ssh15:02:402
13642996021,33cyclictest2062-21ssh18:12:052
13642996020,33cyclictest13917-21ssh17:41:562
13642996016,39cyclictest0-21swapper/216:25:392
13642996016,39cyclictest0-21swapper/216:25:392
13642995921,33cyclictest24213-21ssh15:37:462
13642995920,33cyclictest560-21NetworkManager12:58:342
13642995920,33cyclictest560-21NetworkManager12:58:342
13642995920,33cyclictest3036-21ssh15:07:202
13642995920,33cyclictest20877-21ssh17:51:592
13642995818,34cyclictest20829-21taskset14:39:292
13642995818,34cyclictest20829-21taskset14:39:292
1362999585,47cyclictest0-21swapper/017:47:240
13642995720,31cyclictest24342-21snmpd13:23:092
13642995719,32cyclictest24342-21snmpd13:43:132
1363399574,8cyclictest0-21swapper/117:02:251
1363399574,8cyclictest0-21swapper/117:02:251
1364799564,7cyclictest0-21swapper/317:00:053
1364799563,47cyclictest0-21swapper/316:39:253
13647995619,32cyclictest37-21ksoftirqd/313:41:443
1364799554,46cyclictest0-21swapper/314:38:253
1364799554,46cyclictest0-21swapper/314:38:253
13642995516,33cyclictest24537-21sshd14:48:542
1362999554,45cyclictest0-21swapper/015:57:390
1364299542,6cyclictest10729-21ntp_states14:11:522
1362999547,7cyclictest26642-21diskmemload17:32:440
13629995417,31cyclictest22006-21sshd17:07:160
131242549,16sleep20-21swapper/212:53:202
13647995315,32cyclictest9078-21sshd16:02:183
1363399534,10cyclictest0-21swapper/117:00:551
1363399533,5cyclictest0-21swapper/117:11:251
1362999538,40cyclictest0-21swapper/016:22:260
1362999538,40cyclictest0-21swapper/016:22:260
1362999534,42cyclictest0-21swapper/016:15:160
1362999533,45cyclictest0-21swapper/013:19:540
1364799526,39cyclictest0-21swapper/317:49:263
1364799524,6cyclictest0-21swapper/315:26:173
1364799524,42cyclictest0-21swapper/318:17:133
1364799524,42cyclictest0-21swapper/316:17:463
1364799524,41cyclictest0-21swapper/315:45:473
13642995210,36cyclictest0-21swapper/213:08:072
13642995210,36cyclictest0-21swapper/213:08:072
1362999527,7cyclictest0-21swapper/018:13:230
1362999523,43cyclictest0-21swapper/016:53:050
1362999523,26cyclictest0-21swapper/015:41:340
1362999523,11cyclictest0-21swapper/017:15:550
1362999522,7cyclictest3560-21irqstats16:41:450
13647995041,5cyclictest37-21ksoftirqd/316:41:263
1364799504,41cyclictest0-21swapper/316:12:263
1364799504,40cyclictest0-21swapper/317:33:143
1364799504,40cyclictest0-21swapper/315:13:313
1364799503,41cyclictest0-21swapper/317:26:363
1364799503,41cyclictest0-21swapper/317:03:353
1364799503,41cyclictest0-21swapper/317:03:353
1364799503,10cyclictest0-21swapper/318:15:333
1363399503,41cyclictest0-21swapper/115:31:571
1362999504,41cyclictest0-21swapper/016:37:160
1362999504,40cyclictest0-21swapper/016:30:130
1362999504,39cyclictest0-21swapper/017:00:390
1362999503,42cyclictest31740-21grep15:01:580
1362999503,42cyclictest0-21swapper/018:02:380
1362999503,41cyclictest0-21swapper/017:37:140
1362999503,41cyclictest0-21swapper/017:37:140
1364799494,39cyclictest0-21swapper/315:10:273
1362999494,9cyclictest0-21swapper/015:51:370
1362999494,40cyclictest0-21swapper/016:01:360
13629994939,5cyclictest3-21ksoftirqd/015:11:270
13629994936,8cyclictest0-21swapper/017:56:340
1362999493,41cyclictest0-21swapper/018:23:230
1362999493,40cyclictest588-21irqbalance15:01:280
13629994916,27cyclictest15512-21/usr/sbin/munin15:26:480
13629994916,27cyclictest15512-21/usr/sbin/munin15:26:480
13629994911,32cyclictest0-21swapper/015:37:110
13629994910,33cyclictest0-21swapper/015:22:130
1364799485,37cyclictest0-21swapper/317:25:243
1364799484,40cyclictest0-21swapper/316:08:063
1364799484,38cyclictest0-21swapper/318:10:143
1364799484,38cyclictest0-21swapper/316:52:503
1364799484,38cyclictest0-21swapper/314:57:393
1364799484,37cyclictest0-21swapper/316:46:403
1364799484,37cyclictest0-21swapper/315:58:533
1364799484,37cyclictest0-21swapper/315:55:253
1364799484,37cyclictest0-21swapper/315:19:393
1364799483,8cyclictest0-21swapper/317:12:153
1364799483,40cyclictest0-21swapper/317:52:243
1364799483,40cyclictest0-21swapper/317:43:243
1364799483,39cyclictest0-21swapper/314:16:493
1363399484,38cyclictest0-21swapper/117:53:291
13633994812,5cyclictest0-21swapper/115:58:091
1362999488,7cyclictest0-21swapper/017:51:390
1362999488,34cyclictest0-21swapper/017:29:270
1362999485,35cyclictest0-21swapper/015:31:430
1362999484,38cyclictest0-21swapper/017:01:270
1362999484,38cyclictest0-21swapper/017:01:270
1362999483,40cyclictest0-21swapper/016:32:360
1362999483,40cyclictest0-21swapper/015:50:270
1362999483,39cyclictest0-21swapper/017:17:450
1364799474,37cyclictest0-21swapper/318:23:453
1364799474,37cyclictest0-21swapper/317:58:093
1364799474,37cyclictest0-21swapper/316:28:423
1364799474,37cyclictest0-21swapper/315:28:243
1364799474,37cyclictest0-21swapper/315:28:243
1364799474,36cyclictest0-21swapper/315:39:383
1364799474,18cyclictest0-21swapper/315:02:543
1364799474,17cyclictest0-21swapper/315:34:353
1364799473,39cyclictest0-21swapper/317:17:553
1364799473,39cyclictest0-21swapper/316:23:163
1364799473,39cyclictest0-21swapper/316:23:163
1364799473,38cyclictest0-21swapper/318:03:243
1364799473,12cyclictest0-21swapper/312:56:433
1364799473,12cyclictest0-21swapper/312:56:433
1363399473,9cyclictest0-21swapper/115:10:571
1363399473,38cyclictest0-21swapper/116:24:461
1363399473,38cyclictest0-21swapper/116:24:461
13633994717,25cyclictest667-21runrttasks16:11:071
1362999477,35cyclictest0-21swapper/017:41:260
1362999474,38cyclictest0-21swapper/018:17:460
1362999474,37cyclictest0-21swapper/015:13:420
1362999474,37cyclictest0-21swapper/013:59:210
1362999473,39cyclictest0-21swapper/013:48:190
1362999473,39cyclictest0-21swapper/013:06:410
1362999473,39cyclictest0-21swapper/013:06:410
1362999472,39cyclictest8780-21kworker/0:318:08:540
1364799469,31cyclictest0-21swapper/314:46:443
1364799465,35cyclictest0-21swapper/316:32:593
1364799464,37cyclictest0-21swapper/317:39:553
1364799464,37cyclictest0-21swapper/317:39:553
1364799464,37cyclictest0-21swapper/313:32:003
1364799464,36cyclictest0-21swapper/315:48:403
1364799464,16cyclictest0-21swapper/317:07:053
1364799464,11cyclictest0-21swapper/314:07:223
1364299467,33cyclictest0-21swapper/214:11:292
1363399468,7cyclictest0-21swapper/116:44:191
1363399465,35cyclictest0-21swapper/115:01:541
1363399464,36cyclictest0-21swapper/118:02:301
1363399464,36cyclictest0-21swapper/113:54:201
1362999468,33cyclictest0-21swapper/015:19:550
1362999467,34cyclictest0-21swapper/016:07:210
1362999464,37cyclictest0-21swapper/014:36:280
1362999464,37cyclictest0-21swapper/014:07:020
1362999464,36cyclictest0-21swapper/016:16:390
1362999464,10cyclictest0-21swapper/012:57:110
1362999464,10cyclictest0-21swapper/012:57:110
1362999463,38cyclictest0-21swapper/017:21:570
1362999463,38cyclictest0-21swapper/016:47:360
1362999463,38cyclictest0-21swapper/013:41:430
1362999463,37cyclictest0-21swapper/014:36:470
1362999463,37cyclictest0-21swapper/014:36:470
1362999463,37cyclictest0-21swapper/014:12:160
1362999463,37cyclictest0-21swapper/013:13:410
13629994610,31cyclictest0-21swapper/013:21:530
1364799455,35cyclictest0-21swapper/314:25:233
1364799453,36cyclictest17396-21latency_hist14:31:293
1364799453,36cyclictest0-21swapper/313:40:123
1363399458,31cyclictest0-21swapper/116:54:431
1363399457,32cyclictest0-21swapper/117:23:591
1363399455,34cyclictest0-21swapper/118:13:471
1363399454,36cyclictest0-21swapper/117:31:581
1363399454,36cyclictest0-21swapper/117:28:521
1363399454,35cyclictest0-21swapper/117:20:061
1363399454,35cyclictest0-21swapper/116:31:261
1362999453,36cyclictest0-21swapper/014:41:590
1364799444,35cyclictest0-21swapper/314:05:123
1364799443,35cyclictest0-21swapper/313:31:133
1364799442,8cyclictest11623-21crond14:16:283
1363399445,33cyclictest0-21swapper/117:58:241
1363399445,33cyclictest0-21swapper/117:47:311
1363399445,33cyclictest0-21swapper/117:43:371
1363399445,32cyclictest0-21swapper/116:31:261
1363399444,35cyclictest0-21swapper/117:38:051
1363399444,35cyclictest0-21swapper/117:38:051
1363399444,35cyclictest0-21swapper/116:19:401
1363399444,35cyclictest0-21swapper/116:05:411
1363399444,35cyclictest0-21swapper/115:52:261
1363399444,35cyclictest0-21swapper/115:31:071
1363399444,35cyclictest0-21swapper/115:31:071
1363399443,35cyclictest26809-21ntpq15:41:501
1362999444,9cyclictest0-21swapper/014:06:290
1362999444,35cyclictest0-21swapper/014:55:090
1362999443,36cyclictest0-21swapper/013:06:010
1362999443,36cyclictest0-21swapper/013:06:010
1364799433,9cyclictest0-21swapper/314:33:583
1364799433,35cyclictest0-21swapper/313:47:443
1363399435,32cyclictest0-21swapper/116:16:231
1363399435,32cyclictest0-21swapper/115:37:571
1363399435,32cyclictest0-21swapper/115:18:281
1363399434,33cyclictest0-21swapper/116:39:501
1363399433,35cyclictest0-21swapper/113:02:141
1363399433,35cyclictest0-21swapper/113:02:141
1362999433,35cyclictest0-21swapper/013:56:110
1364799423,6cyclictest0-21swapper/313:26:303
13642994223,14cyclictest22395-21missed_timers13:16:502
1363399424,32cyclictest0-21swapper/118:08:481
1362999423,15cyclictest0-21swapper/013:39:440
233722413,8sleep30-21swapper/313:21:223
1364799414,7cyclictest0-21swapper/313:58:163
1364799413,33cyclictest0-21swapper/313:08:133
1364799413,33cyclictest0-21swapper/313:08:133
1362999413,11cyclictest0-21swapper/013:30:070
13629994111,25cyclictest0-21swapper/014:18:080
1363399405,29cyclictest0-21swapper/115:01:281
1362999406,28cyclictest0-21swapper/014:23:200
211352393,8sleep30-21swapper/313:12:083
187252393,6sleep10-21swapper/114:32:021
1363399394,30cyclictest0-21swapper/113:22:141
13633993928,6cyclictest9806-21grep16:51:251
13633993827,6cyclictest32713-21latency_hist15:51:271
1362999384,7cyclictest0-21swapper/013:33:090
1249123812,18sleep00-21swapper/012:51:530
13647993724,8cyclictest16649-21grep13:01:483
13647993724,8cyclictest16649-21grep13:01:483
1363399374,28cyclictest0-21swapper/115:11:311
1363399374,10cyclictest0-21swapper/114:02:061
158182363,6sleep10-21swapper/113:00:391
158182363,6sleep10-21swapper/113:00:391
1173523612,17sleep30-21swapper/312:51:363
233172353,6sleep10-21swapper/113:20:431
1363399354,26cyclictest0-21swapper/114:16:471
1363399353,27cyclictest0-21swapper/113:12:131
13633993522,9cyclictest26629-21sed13:26:571
157712343,4sleep10-21swapper/114:26:421
1363399344,24cyclictest0-21swapper/118:16:361
1363399343,26cyclictest0-21swapper/114:16:271
13633993421,9cyclictest8369-21sed18:21:561
1313823412,16sleep10-21swapper/112:53:311
263702332,4sleep10-21swapper/117:14:211
13647993323,5cyclictest37-21ksoftirqd/314:53:563
1363399334,25cyclictest0-21swapper/114:21:421
1364799313,22cyclictest0-21swapper/314:41:513
1363399315,20cyclictest0-21swapper/113:50:151
1363399314,23cyclictest0-21swapper/114:50:181
1362999313,23cyclictest0-21swapper/014:46:290
1363399304,22cyclictest0-21swapper/113:40:011
1363399304,21cyclictest0-21swapper/115:22:081
1363399303,23cyclictest0-21swapper/114:55:561
1363399303,23cyclictest0-21swapper/113:59:181
1364799293,21cyclictest0-21swapper/313:51:503
1363399295,18cyclictest0-21swapper/114:36:391
1363399295,18cyclictest0-21swapper/114:36:391
1363399294,21cyclictest0-21swapper/114:45:281
13633992920,6cyclictest28570-21head13:32:001
13633992916,8cyclictest8532-21sort14:06:471
1362999293,20cyclictest0-21swapper/014:26:420
13633992818,6cyclictest32163-21wc13:41:581
13633992715,8cyclictest18392-21cut13:06:461
13633992715,8cyclictest18392-21cut13:06:461
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional