You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-15 - 06:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Nov 15, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20363992621,0cyclictest151rcu_preempt23:44:001
2036299260,1cyclictest313-21systemd-journal19:50:000
2036599250,24cyclictest15489-21ssh00:33:313
2036599250,24cyclictest13289-21diskmemload23:24:573
2036399250,24cyclictest0-21swapper/123:57:181
2036399250,24cyclictest0-21swapper/122:49:271
2036399250,1cyclictest0-21swapper/100:17:351
20362992523,1cyclictest13289-21diskmemload21:22:390
20362992523,1cyclictest0-21swapper/019:32:230
2036299250,24cyclictest2368-21idleruntime-cro19:40:000
2036299250,24cyclictest15880-21basename00:05:010
2036299250,24cyclictest0-21swapper/021:40:460
2036599240,1cyclictest13289-21diskmemload21:20:203
2036499240,23cyclictest3950-21ssh22:57:202
2036499240,23cyclictest0-21swapper/223:21:312
2036499240,0cyclictest0-21swapper/223:58:222
2036499240,0cyclictest0-21swapper/221:15:302
20363992424,0cyclictest0-21swapper/123:30:391
20363992424,0cyclictest0-21swapper/121:29:431
20363992424,0cyclictest0-21swapper/100:36:421
20363992423,1cyclictest13289-21diskmemload23:35:431
20363992423,1cyclictest13289-21diskmemload21:23:431
20363992423,1cyclictest0-21swapper/100:12:391
2036399240,23cyclictest15244-21apt-get23:07:241
2036399240,23cyclictest0-21swapper/121:49:061
2036399240,1cyclictest28873-21munin-run20:35:001
2036399240,0cyclictest0-21swapper/121:58:361
2036399240,0cyclictest0-21swapper/100:01:511
20362992422,1cyclictest62550irq/127-eno123:37:390
2036299240,24cyclictest0-21swapper/022:16:550
2036299240,23cyclictest21306-21df23:12:260
2036299240,23cyclictest20609-21sh00:37:330
2036299240,23cyclictest0-21swapper/023:16:100
2036299240,23cyclictest0-21swapper/022:39:390
2036299240,23cyclictest0-21swapper/000:07:120
2036299240,0cyclictest62550irq/127-eno122:48:530
2036299240,0cyclictest0-21swapper/022:00:090
20365992323,0cyclictest13289-21diskmemload22:55:183
20365992323,0cyclictest0-21swapper/323:36:163
20365992323,0cyclictest0-21swapper/322:08:513
20365992323,0cyclictest0-21swapper/321:39:093
20365992323,0cyclictest0-21swapper/321:16:323
20365992323,0cyclictest0-21swapper/300:08:553
20365992322,0cyclictest0-21swapper/322:41:593
20365992321,1cyclictest8313-21ssh23:29:403
20365992321,1cyclictest28868-21perf20:35:003
20365992321,1cyclictest24823-21ssh23:15:163
2036599230,23cyclictest0-21swapper/322:50:003
2036599230,22cyclictest30396-21ssh23:49:043
2036599230,22cyclictest17924-21ssh22:11:033
2036599230,22cyclictest14521-21ssh23:06:183
2036599230,0cyclictest0-21swapper/323:00:163
2036599230,0cyclictest0-21swapper/322:26:073
2036599230,0cyclictest0-21swapper/321:41:193
20364992323,0cyclictest0-21swapper/223:11:032
20364992323,0cyclictest0-21swapper/223:08:292
20364992323,0cyclictest0-21swapper/221:32:332
20364992320,2cyclictest1823-21ssh00:22:182
20364992320,2cyclictest1017-21ssh22:53:332
20364992320,0cyclictest0-21swapper/222:08:112
20364992320,0cyclictest0-21swapper/200:31:312
2036499230,2cyclictest11973-21ssh21:36:412
2036499230,23cyclictest13289-21diskmemload00:05:152
2036499230,23cyclictest0-21swapper/222:10:462
2036499230,23cyclictest0-21swapper/221:48:122
2036499230,23cyclictest0-21swapper/221:27:362
2036499230,23cyclictest0-21swapper/221:20:412
2036499230,22cyclictest27561-21sh00:15:462
2036499230,22cyclictest19955-21ssh21:42:352
2036499230,22cyclictest16937-21tail21:12:292
2036499230,22cyclictest14028-21ssh22:37:052
2036499230,22cyclictest13289-21diskmemload22:25:592
2036499230,22cyclictest0-21swapper/222:44:362
2036499230,0cyclictest13289-21diskmemload21:59:342
2036499230,0cyclictest13289-21diskmemload00:25:462
2036499230,0cyclictest0-21swapper/223:35:242
2036499230,0cyclictest0-21swapper/200:36:532
20363992323,0cyclictest0-21swapper/123:27:071
20363992323,0cyclictest0-21swapper/122:30:191
20363992323,0cyclictest0-21swapper/122:28:221
20363992322,1cyclictest13289-21diskmemload21:33:451
20363992322,0cyclictest0-21swapper/122:12:081
20363992320,2cyclictest13289-21diskmemload22:03:091
2036399230,2cyclictest26355-21rm23:45:451
2036399230,22cyclictest622-21gdbus20:45:001
2036399230,22cyclictest16612-21sh22:38:101
2036399230,22cyclictest1441-21ssh00:21:491
2036399230,22cyclictest13289-21diskmemload23:18:481
2036399230,22cyclictest13289-21diskmemload21:35:201
2036399230,22cyclictest0-21swapper/122:57:251
2036399230,22cyclictest0-21swapper/122:51:281
2036399230,0cyclictest13289-21diskmemload23:14:051
2036399230,0cyclictest13289-21diskmemload21:41:031
2036399230,0cyclictest13289-21diskmemload21:11:461
2036399230,0cyclictest0-21swapper/123:00:551
2036399230,0cyclictest0-21swapper/121:54:051
2036399230,0cyclictest0-21swapper/121:16:161
2036399230,0cyclictest0-21swapper/119:27:241
20362992323,0cyclictest13289-21diskmemload23:21:130
20362992323,0cyclictest0-21swapper/022:40:350
20362992322,1cyclictest62550irq/127-eno121:10:160
20362992321,2cyclictest0-21swapper/022:52:130
20362992321,1cyclictest25132-21cron19:20:010
20362992321,1cyclictest0-21swapper/023:30:180
20362992321,1cyclictest0-21swapper/023:28:390
20362992321,1cyclictest0-21swapper/021:35:360
2036299230,23cyclictest0-21swapper/023:08:370
2036299230,23cyclictest0-21swapper/022:20:180
2036299230,23cyclictest0-21swapper/000:23:450
2036299230,22cyclictest8429-21find21:32:310
2036299230,22cyclictest4047-21diskmemload22:27:290
2036299230,22cyclictest3848-21diskmemload22:57:130
2036299230,22cyclictest31161-21apt-get23:50:020
2036299230,22cyclictest30849-21ssh00:17:550
2036299230,22cyclictest13289-21diskmemload21:15:020
2036299230,22cyclictest0-21swapper/000:27:510
2036299230,1cyclictest22438-21kworker/u8:121:51:440
2036299230,1cyclictest13289-21diskmemload21:25:290
2036299230,0cyclictest0-21swapper/023:03:380
20365992222,0cyclictest13289-21diskmemload23:41:263
20365992222,0cyclictest13289-21diskmemload22:16:493
20365992222,0cyclictest13289-21diskmemload00:21:313
20365992222,0cyclictest0-21swapper/322:50:263
20365992222,0cyclictest0-21swapper/322:30:343
20365992222,0cyclictest0-21swapper/322:02:583
20365992222,0cyclictest0-21swapper/300:11:443
20365992221,1cyclictest5500-21sh21:30:293
20365992221,1cyclictest13289-21diskmemload22:20:123
20365992220,1cyclictest27994-21apt-get19:27:243
20365992220,1cyclictest19223-21idleruntime-cro20:15:013
20365992220,1cyclictest13417-21sh22:36:053
20365992220,1cyclictest0-21swapper/323:11:113
2036599220,22cyclictest8965-21ssh23:30:093
2036599220,22cyclictest16868-21perf20:10:013
2036599220,22cyclictest0-21swapper/300:15:313
2036599220,21cyclictest17224-21ssh00:35:083
2036599220,21cyclictest15553-21sh00:04:313
2036599220,21cyclictest13322-21latency_hist21:10:003
2036599220,21cyclictest13289-21diskmemload23:55:333
2036599220,1cyclictest704-21ssh21:27:093
2036599220,1cyclictest15102-21sh21:11:273
2036599220,0cyclictest0-21swapper/321:47:113
20364992222,0cyclictest0-21swapper/222:45:232
20364992222,0cyclictest0-21swapper/222:31:562
20364992222,0cyclictest0-21swapper/200:11:192
20364992222,0cyclictest0-21swapper/200:03:402
20364992220,1cyclictest0-21swapper/223:25:102
20364992220,1cyclictest0-21swapper/219:55:002
2036499220,22cyclictest13289-21diskmemload23:44:002
2036499220,22cyclictest0-21swapper/223:30:092
2036499220,22cyclictest0-21swapper/222:15:122
2036499220,21cyclictest364-21ssh23:51:312
2036499220,21cyclictest29001-21rm22:21:072
2036499220,21cyclictest2796-21apt-get19:42:252
2036499220,21cyclictest24750-21ssh23:15:102
2036499220,21cyclictest0-21swapper/222:01:472
2036499220,1cyclictest27934-21ssh23:47:262
2036499220,1cyclictest0-21swapper/220:27:242
2036499220,0cyclictest13289-21diskmemload21:53:192
20363992222,0cyclictest13289-21diskmemload22:09:261
20363992222,0cyclictest0-21swapper/123:51:071
20363992220,1cyclictest10894-21idleruntime-cro21:05:001
20363992220,1cyclictest0-21swapper/122:41:231
20363992219,2cyclictest606-21dbus-daemon20:25:001
2036399220,22cyclictest0-21swapper/122:23:031
2036399220,22cyclictest0-21swapper/100:30:401
2036399220,21cyclictest6540-21apt-get20:57:251
2036399220,21cyclictest0-21swapper/123:20:151
2036399220,21cyclictest0-21swapper/100:07:041
20362992221,1cyclictest0-21swapper/021:47:110
20362992220,1cyclictest8493-21sh21:00:010
20362992220,1cyclictest5002-21ssh23:55:170
20362992220,1cyclictest0-21swapper/022:30:040
2036299220,21cyclictest25601-21apt-get19:22:240
2036299220,21cyclictest22055-21diskmemload00:10:310
2036299220,21cyclictest13303-21cron21:10:000
2036299220,21cyclictest13289-21diskmemload23:46:160
2036299220,21cyclictest0-21swapper/023:41:320
2036299220,21cyclictest0-21swapper/022:10:060
2036299220,21cyclictest0-21swapper/022:07:340
2036299220,21cyclictest0-21swapper/000:30:320
2036299220,1cyclictest12016-21sendmail-msp20:00:000
2036299220,1cyclictest0-21swapper/021:55:070
20365992120,1cyclictest0-21swapper/320:02:253
2036599210,21cyclictest7261-21ssh00:27:163
2036599210,20cyclictest4090-21apt-get20:52:263
2036599210,20cyclictest0-21swapper/319:57:253
2036599210,1cyclictest28816-21ssh21:51:483
2036599210,0cyclictest32427-21ssh23:51:003
2036599210,0cyclictest0-21swapper/321:55:573
20363992120,0cyclictest0-21swapper/120:07:251
2036399210,21cyclictest0-21swapper/120:12:241
2036399210,20cyclictest0-21swapper/120:37:251
2036399210,1cyclictest27557-21perf19:25:011
20362992121,0cyclictest0-21swapper/020:47:240
20362992120,0cyclictest0-21swapper/020:07:250
20362992118,2cyclictest21644-21turbostat.cron20:20:000
20365992020,0cyclictest31710-21apt-get20:42:233
2036599200,20cyclictest0-21swapper/319:37:263
2036599200,0cyclictest0-21swapper/319:42:253
20364992020,0cyclictest0-21swapper/220:47:242
20363992020,0cyclictest0-21swapper/120:52:251
20363992020,0cyclictest0-21swapper/119:52:241
20363992020,0cyclictest0-21swapper/119:42:251
20363992020,0cyclictest0-21swapper/119:32:231
20362992020,0cyclictest24503-21apt-get20:27:240
20362992020,0cyclictest0-21swapper/020:22:240
20362992020,0cyclictest0-21swapper/019:42:250
2036299200,0cyclictest0-21swapper/019:27:240
20365991919,0cyclictest29297-21apt-get20:37:253
20365991919,0cyclictest0-21swapper/319:52:233
20364991919,0cyclictest0-21swapper/219:17:232
20364991917,1cyclictest32352-21dump-pmu-power19:35:002
20364991917,1cyclictest28867-21grep20:35:002
20363991919,0cyclictest0-21swapper/120:02:251
20362991917,1cyclictest19259-21munin-run20:15:010
20365991818,0cyclictest30391-21apt-get19:32:233
20365991818,0cyclictest20791-21apt-get19:12:263
20364991818,0cyclictest12502-21apt-get20:02:252
20364991818,0cyclictest0-21swapper/221:07:252
20363991818,0cyclictest0-21swapper/120:17:251
20363991818,0cyclictest0-21swapper/119:57:251
20362991818,0cyclictest0-21swapper/020:52:260
20362991818,0cyclictest0-21swapper/020:37:250
20362991818,0cyclictest0-21swapper/020:02:250
20365991717,0cyclictest0-21swapper/321:02:253
20365991717,0cyclictest0-21swapper/320:22:253
20365991716,0cyclictest0-21swapper/319:22:243
20364991717,0cyclictest0-21swapper/220:37:252
2036499170,1cyclictest5185-21apt-get19:47:222
20363991717,0cyclictest13313-21apt-get21:10:001
20363991717,0cyclictest0-21swapper/119:12:261
20363991716,1cyclictest23182-21apt-get19:17:231
20362991717,0cyclictest0-21swapper/021:02:240
20362991717,0cyclictest0-21swapper/020:42:230
2036599166,9cyclictest28200-21munin-node19:48:083
20365991616,0cyclictest0-21swapper/320:57:253
20364991615,1cyclictest29940-21awk19:30:002
2036299160,15cyclictest9655-21munin-run19:55:000
20364991515,0cyclictest8957-21apt-get21:02:242
20364991515,0cyclictest19687-21apt-get20:17:252
20364991514,1cyclictest10034-21apt-get19:57:252
20363991515,0cyclictest0-21swapper/120:47:241
20362991515,0cyclictest0-21swapper/020:32:250
2036299150,14cyclictest0-21swapper/019:11:550
20365991414,0cyclictest0-21swapper/319:15:143
2036599140,14cyclictest0-21swapper/320:25:303
2036599140,0cyclictest0-21swapper/320:45:313
2036599140,0cyclictest0-21swapper/320:15:203
2036499140,14cyclictest0-21swapper/220:55:172
2036499140,14cyclictest0-21swapper/220:40:282
2036499140,14cyclictest0-21swapper/220:20:282
2036499140,14cyclictest0-21swapper/220:10:062
2036499140,14cyclictest0-21swapper/220:05:252
2036499140,14cyclictest0-21swapper/219:36:062
2036499140,14cyclictest0-21swapper/219:21:572
2036499140,0cyclictest0-21swapper/220:50:212
2036499140,0cyclictest0-21swapper/219:11:502
2036399140,14cyclictest0-21swapper/119:45:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional