You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-17 - 07:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot4.osadl.org (updated Wed Sep 17, 2025 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6742660,7sleep30-21swapper/316:20:543
6742660,7sleep30-21swapper/316:20:543
2067499662,8cyclictest21272-21/usr/sbin/munin13:36:033
2066899625,52cyclictest19282-21ssh16:49:502
2066899604,8cyclictest0-21swapper/214:12:072
20674995927,26cyclictest726-21crond18:45:353
2066899595,47cyclictest0-21swapper/216:22:392
2066899595,47cyclictest0-21swapper/216:22:392
2008225911,17sleep10-21swapper/113:31:441
2066899584,48cyclictest0-21swapper/215:00:562
20668995815,37cyclictest11818-21ssh16:38:342
20668995811,41cyclictest10576-21timerwakeupswit14:31:142
20674995729,23cyclictest27871-21tr18:35:583
20674995729,23cyclictest27871-21tr18:35:583
2067499572,48cyclictest378-21systemd-journal17:23:193
2066899579,42cyclictest7621-21/usr/sbin/munin14:26:032
20674995624,27cyclictest8048-21sort18:06:093
2066899563,47cyclictest26168-21kworker/2:216:17:092
2066899563,47cyclictest0-21swapper/216:41:092
20668995614,36cyclictest3578-21ssh15:37:532
20674995522,28cyclictest25189-21grep18:31:093
20674995521,28cyclictest4602-21/usr/sbin/munin17:15:593
20674995516,33cyclictest21011-21cut18:25:523
20674995515,34cyclictest667-21runrttasks16:03:583
20674995514,35cyclictest667-21runrttasks14:18:433
20668995515,35cyclictest9925-21ssh15:46:252
20668995514,36cyclictest19108-21sed17:36:012
20668995510,39cyclictest1193-21df_inode18:45:512
2065699559,40cyclictest0-21swapper/017:06:280
2065699556,43cyclictest3434-21ssh16:25:380
2065699556,43cyclictest3434-21ssh16:25:380
2067499543,44cyclictest30808-21/usr/sbin/munin17:05:553
2066899549,39cyclictest32344-21/usr/sbin/munin17:55:552
2066899549,39cyclictest23763-21fschecks_time16:55:532
2066899544,45cyclictest0-21swapper/218:20:062
20668995414,34cyclictest26164-21ntp_kernel_pll_17:46:002
2066099544,44cyclictest0-21swapper/116:19:351
2066099543,45cyclictest0-21swapper/117:20:581
2065699540,48cyclictest21816-21kworker/0:217:44:170
2067499533,10cyclictest4782-21sed18:01:093
20674995322,25cyclictest29640-21ntpq17:51:003
20674995320,26cyclictest2516-21grep17:11:113
20674995320,26cyclictest2516-21grep17:11:113
20674995318,30cyclictest26162-21fschecks_time16:10:563
20674995318,29cyclictest13949-21cut14:41:053
20674995312,34cyclictest21271-21runrttasks15:00:583
2067499531,46cyclictest16231-21sed16:45:393
2066899538,39cyclictest25039-21ssh17:45:312
2066899538,39cyclictest0-21swapper/218:30:472
2066899536,41cyclictest9425-21ssh17:21:182
20668995312,35cyclictest0-21swapper/218:05:372
20668995312,35cyclictest0-21swapper/217:32:072
20668995310,37cyclictest0-21swapper/218:26:532
2066099535,43cyclictest0-21swapper/118:34:461
2066099533,44cyclictest0-21swapper/118:10:371
20674995221,26cyclictest667-21runrttasks17:42:423
2067499522,43cyclictest17008-21/usr/sbin/munin14:50:573
20674995219,28cyclictest557-21systemd-logind18:15:373
20674995219,28cyclictest557-21systemd-logind18:15:373
20674995218,29cyclictest647-21wc14:06:013
20674995218,29cyclictest647-21wc14:06:013
20674995216,31cyclictest5297-21fschecks_time15:40:563
20674995215,32cyclictest667-21runrttasks14:58:143
20674995212,34cyclictest574-21dbus-daemon16:15:403
20674995212,34cyclictest26647-21cut15:15:563
20674995211,34cyclictest29449-21needreboot13:56:073
2066899529,37cyclictest32011-21/usr/sbin/munin15:31:032
2066899528,38cyclictest6979-21df18:55:532
2066899528,38cyclictest30125-21/usr/sbin/munin15:25:572
2066899528,38cyclictest30125-21/usr/sbin/munin15:25:572
2066899527,39cyclictest32172-21ssh17:07:272
2066899527,39cyclictest12733-21ssh15:51:062
2066899527,39cyclictest11428-21basename14:35:522
2066899526,40cyclictest24500-21/usr/sbin/munin15:10:522
2066899525,41cyclictest0-21swapper/215:44:202
2066899524,43cyclictest0-21swapper/218:11:572
2066899524,43cyclictest0-21swapper/218:11:572
2066899524,43cyclictest0-21swapper/216:30:192
2066899524,42cyclictest0-21swapper/215:58:262
20668995213,33cyclictest0-21swapper/216:32:002
20668995212,34cyclictest0-21swapper/218:54:502
20668995212,34cyclictest0-21swapper/217:12:152
20668995212,34cyclictest0-21swapper/217:12:152
20668995210,36cyclictest378-21systemd-journal14:21:082
20668995210,36cyclictest20187-21vmstat16:01:122
2066099524,42cyclictest0-21swapper/118:17:291
2066099523,44cyclictest0-21swapper/118:22:461
2067499512,44cyclictest15945-21ps14:46:063
20674995116,29cyclictest23560-21grep16:06:123
20674995116,29cyclictest12114-21missed_timers17:25:583
20674995115,30cyclictest667-21runrttasks13:53:543
20674995115,30cyclictest10606-21cat16:36:053
20674995114,31cyclictest27441-21latency17:00:593
2066899517,38cyclictest27551-21ssh16:12:122
2066899517,38cyclictest20151-21ssh18:25:132
2066899517,38cyclictest13432-21diskstats14:40:572
2066899515,40cyclictest0-21swapper/217:29:472
2066899515,40cyclictest0-21swapper/216:52:422
20668995111,34cyclictest0-21swapper/216:06:452
20668995110,35cyclictest28248-21/usr/sbin/munin15:21:142
20668995110,35cyclictest17008-21/usr/sbin/munin14:50:582
2066099514,41cyclictest0-21swapper/118:51:001
2066099514,41cyclictest0-21swapper/117:59:271
2066099514,41cyclictest0-21swapper/117:42:371
2066099514,13cyclictest0-21swapper/116:57:281
2065699514,42cyclictest0-21swapper/017:30:180
2065699514,41cyclictest0-21swapper/017:39:070
2067499503,9cyclictest25427-21perl13:45:583
2067499503,7cyclictest1629-21sh17:56:533
2067499503,6cyclictest20354-21ssh17:37:323
2067499503,6cyclictest17349-21ssh17:33:413
2067499503,41cyclictest9506-21ps14:30:523
2067499502,7cyclictest2404-21rm15:36:053
2067499502,42cyclictest15901-21iostat_ios15:55:593
2067499502,41cyclictest12303-21fschecks_time15:50:593
20674995019,26cyclictest24364-21latency_hist15:10:413
20674995018,27cyclictest25964-21latency17:45:573
20674995017,28cyclictest28987-21grep15:21:033
20674995015,30cyclictest667-21runrttasks15:27:373
20674995015,30cyclictest667-21runrttasks15:27:373
20674995015,29cyclictest4028-21sort16:25:543
20674995014,31cyclictest32471-21if_eth215:30:573
20674995013,32cyclictest10615-21rt-features19:01:053
20674995012,6cyclictest20679-21netstat16:51:033
20674995012,32cyclictest31773-21unixbench-2d14:01:163
20674995012,32cyclictest31773-21unixbench-2d14:01:163
20674995011,33cyclictest378-21systemd-journal14:22:433
2066899508,37cyclictest26938-21wget17:00:522
2066899508,36cyclictest5252-21/usr/sbin/munin17:15:572
2066899508,36cyclictest30382-21/usr/sbin/munin18:40:482
2066899508,36cyclictest10290-21cat19:00:572
2066899504,40cyclictest0-21swapper/218:08:072
2066899504,40cyclictest0-21swapper/217:51:212
2066099505,39cyclictest0-21swapper/117:28:191
2066099504,40cyclictest0-21swapper/116:14:571
2066099504,21cyclictest0-21swapper/118:04:391
2065699504,41cyclictest0-21swapper/017:18:380
2065699504,41cyclictest0-21swapper/015:41:200
20656995011,34cyclictest0-21swapper/015:55:480
20656995011,33cyclictest0-21swapper/016:46:460
20656995010,34cyclictest0-21swapper/015:47:250
2067499494,38cyclictest0-21swapper/315:49:553
2067499493,9cyclictest2175-21/usr/sbin/munin18:46:103
2067499492,7cyclictest15002-21unixbench_multi18:16:093
20674994914,30cyclictest667-21runrttasks13:43:473
20674994914,30cyclictest23828-21idleruntime16:55:543
20674994912,32cyclictest574-21dbus-daemon14:40:413
20674994911,5cyclictest18324-21sh16:47:303
2066899499,11cyclictest22628-21/usr/sbin/munin15:06:052
2066899497,36cyclictest27236-21/usr/sbin/munin15:16:062
2066899497,36cyclictest19628-21/usr/sbin/munin14:56:032
2066899497,36cyclictest1561-21sshd14:08:082
2066899497,36cyclictest1561-21sshd14:08:082
2066899496,38cyclictest0-21swapper/214:46:032
20668994913,30cyclictest29051-21ssh18:37:502
20668994913,30cyclictest29051-21ssh18:37:502
2066099497,36cyclictest0-21swapper/117:06:081
2066099494,40cyclictest0-21swapper/118:56:391
20660994913,31cyclictest31137-21sshd17:53:231
20660994912,31cyclictest0-21swapper/113:56:081
2065699498,35cyclictest0-21swapper/018:01:400
2065699495,38cyclictest0-21swapper/016:30:330
2065699495,38cyclictest0-21swapper/016:06:160
2065699495,10cyclictest10242-21ssh18:10:390
2065699495,10cyclictest10242-21ssh18:10:390
2065699493,41cyclictest0-21swapper/018:23:260
2065699493,41cyclictest0-21swapper/017:59:170
2065699493,40cyclictest21234-21fschecks_count13:35:490
2065699493,40cyclictest19914-21/usr/sbin/munin16:51:130
2067499484,20cyclictest0-21swapper/318:21:003
2067499483,8cyclictest8710-21/usr/sbin/munin14:26:113
20674994818,24cyclictest6991-21df_inode18:55:543
20674994812,31cyclictest667-21runrttasks16:34:453
20674994810,5cyclictest0-21swapper/314:10:573
2066899484,12cyclictest0-21swapper/214:16:092
2066099484,9cyclictest0-21swapper/118:13:171
2066099484,9cyclictest0-21swapper/118:13:171
2066099484,38cyclictest0-21swapper/118:29:591
2066099484,38cyclictest0-21swapper/116:43:111
2066099484,38cyclictest0-21swapper/115:49:041
2066099483,40cyclictest0-21swapper/117:30:511
2066099483,40cyclictest0-21swapper/115:42:501
2066099483,39cyclictest0-21swapper/119:03:291
20660994811,31cyclictest0-21swapper/116:24:411
20660994811,31cyclictest0-21swapper/116:24:411
20660994811,31cyclictest0-21swapper/116:04:081
2065699485,19cyclictest0-21swapper/016:11:240
20656994810,33cyclictest0-21swapper/017:32:460
2067499474,9cyclictest0-21swapper/318:50:503
2066899476,35cyclictest28670-21latency_hist13:55:432
2066899474,38cyclictest0-21swapper/213:56:042
2066899473,39cyclictest0-21swapper/213:41:032
2066899473,38cyclictest0-21swapper/214:01:282
2066899473,38cyclictest0-21swapper/214:01:282
2066099474,38cyclictest0-21swapper/116:51:311
2066099474,38cyclictest0-21swapper/115:51:321
2066099474,38cyclictest0-21swapper/115:39:081
2066099474,37cyclictest0-21swapper/116:39:301
2066099474,37cyclictest0-21swapper/115:57:171
2066099473,39cyclictest0-21swapper/116:31:001
20660994711,5cyclictest0-21swapper/117:47:171
20660994711,5cyclictest0-21swapper/117:38:121
20660994711,5cyclictest0-21swapper/117:04:151
20660994711,30cyclictest0-21swapper/117:11:101
20660994711,30cyclictest0-21swapper/117:11:101
2065699479,7cyclictest0-21swapper/016:16:150
2065699475,37cyclictest0-21swapper/018:29:220
2065699474,37cyclictest0-21swapper/015:51:570
20656994712,29cyclictest2403-21/usr/sbin/munin15:36:050
2065699471,40cyclictest0-21swapper/017:14:150
2065699471,40cyclictest0-21swapper/017:14:150
2065699471,40cyclictest0-21swapper/016:38:580
2065699471,40cyclictest0-21swapper/016:04:150
2065699471,13cyclictest0-21swapper/016:56:540
2067499463,36cyclictest24855-21fschecks_time15:10:563
2066099464,38cyclictest0-21swapper/113:40:501
2066099464,36cyclictest0-21swapper/117:16:501
2066099464,36cyclictest0-21swapper/114:05:551
2066099464,36cyclictest0-21swapper/114:05:551
2066099463,38cyclictest0-21swapper/118:36:231
2066099463,38cyclictest0-21swapper/118:36:231
20660994612,5cyclictest0-21swapper/113:46:071
20660994610,5cyclictest0-21swapper/118:46:241
20660994610,5cyclictest0-21swapper/116:45:441
20660994610,5cyclictest0-21swapper/116:28:241
2065699468,32cyclictest0-21swapper/017:45:490
2065699464,37cyclictest0-21swapper/016:40:490
2066899454,9cyclictest0-21swapper/213:36:012
2066099458,14cyclictest0-21swapper/118:43:251
2066099454,36cyclictest0-21swapper/116:06:221
2066099454,35cyclictest0-21swapper/113:50:511
2065699458,7cyclictest0-21swapper/016:34:430
2065699455,34cyclictest0-21swapper/017:04:030
2065699454,36cyclictest0-21swapper/018:15:400
2066099444,35cyclictest0-21swapper/114:01:121
2066099444,35cyclictest0-21swapper/114:01:121
2065699445,33cyclictest0-21swapper/018:10:370
2065699435,32cyclictest0-21swapper/018:56:170
20656994311,27cyclictest30657-21ssh17:52:110
2066099423,34cyclictest0-21swapper/113:38:171
2066099423,33cyclictest2155-21df14:10:541
2065699404,30cyclictest0-21swapper/013:41:150
2066899393,30cyclictest0-21swapper/213:50:432
2023223815,17sleep20-21swapper/213:33:262
2065699374,29cyclictest0-21swapper/018:51:260
2036723713,18sleep30-21swapper/313:35:043
297502363,6sleep10-21swapper/115:23:551
2066099364,27cyclictest0-21swapper/115:05:561
2065699364,27cyclictest0-21swapper/013:51:050
2065699364,26cyclictest0-21swapper/018:31:060
2065699364,26cyclictest0-21swapper/013:56:080
192172369,19sleep00-21swapper/013:30:590
71092353,6sleep10-21swapper/114:22:221
282362353,8sleep00-21swapper/015:20:440
223862353,6sleep10-21swapper/115:05:281
2066099353,26cyclictest0-21swapper/114:55:461
2065699355,24cyclictest0-21swapper/019:03:300
2065699354,26cyclictest0-21swapper/014:03:430
2065699354,26cyclictest0-21swapper/014:03:430
2065699354,26cyclictest0-21swapper/013:46:030
2065699354,25cyclictest0-21swapper/014:06:130
2065699354,25cyclictest0-21swapper/014:06:130
20656993522,8cyclictest31075-21awk18:41:000
2066099344,25cyclictest0-21swapper/114:32:511
20660993415,14cyclictest13455-21fschecks_count14:40:581
2065699344,25cyclictest0-21swapper/018:50:110
90062333,7sleep10-21swapper/114:27:251
2066099334,25cyclictest0-21swapper/114:49:351
2066099333,25cyclictest0-21swapper/114:55:111
20660993323,6cyclictest574-21dbus-daemon15:15:411
20660993322,6cyclictest32193-21forks15:30:541
20660993321,7cyclictest12608-21grep14:36:121
20660993320,9cyclictest25647-21sed15:11:111
2065699334,25cyclictest0-21swapper/014:57:050
20656993320,8cyclictest3148-21grep14:11:110
20656993316,12cyclictest0-21swapper/014:25:000
20656993316,10cyclictest0-21swapper/015:16:350
20656993221,7cyclictest16231-21grep14:46:100
20656993217,10cyclictest0-21swapper/017:20:510
20656993216,11cyclictest0-21swapper/014:31:110
20656993216,10cyclictest0-21swapper/014:19:480
20656993214,13cyclictest667-21runrttasks14:27:530
2066099313,23cyclictest0-21swapper/114:15:501
2065699317,18cyclictest32423-21runrttasks15:30:560
2065699314,22cyclictest0-21swapper/014:45:350
20656993117,10cyclictest0-21swapper/015:27:250
20656993117,10cyclictest0-21swapper/015:27:250
20656993116,10cyclictest0-21swapper/018:36:200
20656993116,10cyclictest0-21swapper/018:36:200
20656993116,10cyclictest0-21swapper/015:09:410
20656993115,10cyclictest0-21swapper/015:00:540
20660993015,10cyclictest0-21swapper/115:25:581
20660993015,10cyclictest0-21swapper/115:25:581
2065699305,19cyclictest18207-21tail14:51:130
20656993019,7cyclictest25016-21kernelversion15:10:590
20656993015,11cyclictest0-21swapper/014:36:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional