You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-01 - 03:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Wed Apr 01, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2405399250,1cyclictest27782-21ssh00:29:253
2405199253,1cyclictest28-21ksoftirqd/200:15:012
2405199250,24cyclictest18082-21diskmemload00:23:502
2404799250,1cyclictest0-21swapper/121:10:241
24043992523,2cyclictest0-21swapper/023:31:120
2404399250,24cyclictest6498-21ssh22:02:210
2404399250,24cyclictest0-21swapper/022:51:150
2405399240,0cyclictest0-21swapper/319:23:273
2405199240,23cyclictest0-21swapper/222:45:002
2405199240,23cyclictest0-21swapper/221:54:082
24047992422,1cyclictest4376-21grep23:03:301
2404799240,24cyclictest0-21swapper/123:47:341
2404799240,24cyclictest0-21swapper/122:54:081
2404799240,24cyclictest0-21swapper/122:43:261
2404799240,24cyclictest0-21swapper/100:11:211
2404799240,23cyclictest18082-21diskmemload22:22:141
2404799240,23cyclictest18082-21diskmemload22:18:471
2404799240,23cyclictest11238-21ssh23:41:061
2404799240,23cyclictest0-21swapper/122:30:001
2404799240,0cyclictest0-21swapper/123:32:161
2404799240,0cyclictest0-21swapper/100:35:511
24043992424,0cyclictest0-21swapper/022:37:080
24043992422,1cyclictest0-21swapper/023:22:410
24043992421,2cyclictest19066-21ssh22:45:340
24043992420,3cyclictest9559-21rm23:38:510
2404399240,24cyclictest0-21swapper/023:46:580
2404399240,23cyclictest17636-21sh21:41:020
2404399240,23cyclictest1457-21lockfile-create23:00:010
2404399240,23cyclictest0-21swapper/022:41:130
2404399240,1cyclictest22087-21munin-run23:20:010
2404399240,0cyclictest18082-21diskmemload23:42:590
2404399240,0cyclictest18082-21diskmemload23:09:280
2404399240,0cyclictest0-21swapper/023:27:020
2404399240,0cyclictest0-21swapper/022:13:210
2404399240,0cyclictest0-21swapper/022:13:210
24053992323,0cyclictest0-21swapper/322:16:523
24053992322,1cyclictest18082-21diskmemload22:30:353
24053992322,1cyclictest0-21swapper/322:07:403
24053992321,1cyclictest21905-21munin-run23:20:013
24053992321,1cyclictest0-21swapper/323:41:383
24053992321,1cyclictest0-21swapper/323:21:573
24053992321,1cyclictest0-21swapper/300:20:003
24053992321,1cyclictest0-21swapper/300:06:043
24053992320,2cyclictest31323-21sh22:26:083
24053992320,2cyclictest29743-21rm22:24:013
24053992319,1cyclictest151rcu_preempt22:55:003
2405399230,23cyclictest18082-21diskmemload21:46:173
2405399230,23cyclictest0-21swapper/323:25:293
2405399230,23cyclictest0-21swapper/322:59:093
2405399230,23cyclictest0-21swapper/322:48:283
2405399230,23cyclictest0-21swapper/322:38:223
2405399230,23cyclictest0-21swapper/321:50:053
2405399230,23cyclictest0-21swapper/321:33:083
2405399230,22cyclictest431-21rm23:30:093
2405399230,22cyclictest32420-21ssh21:55:033
2405399230,22cyclictest31872-21apt-get00:03:243
2405399230,22cyclictest26636-21ssh23:56:123
2405399230,22cyclictest21518-21ssh23:51:083
2405399230,22cyclictest0-21swapper/323:05:123
2405399230,1cyclictest0-21swapper/321:15:023
2405399230,0cyclictest18082-21diskmemload21:25:223
2405399230,0cyclictest0-21swapper/323:13:463
2405399230,0cyclictest0-21swapper/322:44:353
24051992323,0cyclictest0-21swapper/223:35:102
24051992323,0cyclictest0-21swapper/223:15:272
24051992322,1cyclictest0-21swapper/223:45:092
24051992322,1cyclictest0-21swapper/222:59:252
24051992322,1cyclictest0-21swapper/221:29:102
24051992322,0cyclictest0-21swapper/223:43:332
24051992321,1cyclictest4638-21irqstats23:03:312
24051992321,1cyclictest31153-21sh22:25:522
24051992321,1cyclictest0-21swapper/223:55:462
24051992321,1cyclictest0-21swapper/221:43:322
24051992321,1cyclictest0-21swapper/219:55:012
2405199231,1cyclictest21292-21ssh23:50:472
2405199230,2cyclictest7017-21ssh21:30:242
2405199230,23cyclictest18082-21diskmemload23:22:472
2405199230,23cyclictest0-21swapper/221:23:142
2405199230,22cyclictest623-21ssh23:30:242
2405199230,22cyclictest26212-21gltestperf21:18:302
2405199230,22cyclictest18082-21diskmemload22:35:482
2405199230,22cyclictest0-21swapper/222:17:112
2405199230,0cyclictest0-21swapper/200:00:402
24047992323,0cyclictest18082-21diskmemload22:12:301
24047992323,0cyclictest18082-21diskmemload22:12:301
24047992323,0cyclictest0-21swapper/121:30:081
24047992323,0cyclictest0-21swapper/121:27:511
24047992323,0cyclictest0-21swapper/100:32:341
24047992322,1cyclictest2539-21sh00:05:131
24047992321,1cyclictest5453-21rm23:35:041
24047992321,1cyclictest0-21swapper/123:13:361
24047992321,1cyclictest0-21swapper/122:05:271
24047992320,2cyclictest22658-21ssh21:45:481
2404799231,1cyclictest0-21swapper/121:18:321
2404799230,2cyclictest12335-21sh21:35:461
2404799230,2cyclictest10821-21chrt22:38:281
2404799230,23cyclictest0-21swapper/123:51:401
2404799230,23cyclictest0-21swapper/123:23:431
2404799230,23cyclictest0-21swapper/121:40:111
2404799230,23cyclictest0-21swapper/100:01:151
2404799230,22cyclictest18082-21diskmemload00:27:231
2404799230,22cyclictest18039-21sh23:16:381
2404799230,22cyclictest13073-21sh00:15:061
2404799230,0cyclictest0-21swapper/123:28:271
24043992323,0cyclictest0-21swapper/023:11:590
24043992323,0cyclictest0-21swapper/000:37:450
24043992323,0cyclictest0-21swapper/000:29:250
24043992323,0cyclictest0-21swapper/000:11:370
24043992323,0cyclictest0-21swapper/000:09:520
2404399232,1cyclictest62550irq/127-eno121:31:250
2404399230,23cyclictest0-21swapper/022:30:180
2404399230,23cyclictest0-21swapper/022:27:560
2404399230,22cyclictest374-21cron20:35:010
2404399230,22cyclictest29337-21ssh21:21:130
2404399230,22cyclictest29126-21apt-key00:00:010
2404399230,22cyclictest27040-21rm22:22:280
2404399230,22cyclictest22161-21ssh22:17:460
2404399230,22cyclictest18082-21diskmemload21:16:090
2404399230,22cyclictest18082-21diskmemload00:33:350
2404399230,22cyclictest16307-21sh21:39:210
2404399230,22cyclictest1565-21ssh21:25:260
2404399230,0cyclictest0-21swapper/023:54:490
2404399230,0cyclictest0-21swapper/022:06:010
2404399230,0cyclictest0-21swapper/021:46:230
24053992222,0cyclictest0-21swapper/321:35:543
24053992221,0cyclictest0-21swapper/300:36:143
24053992220,1cyclictest32692-21sh21:23:523
24053992220,1cyclictest13323-21sendmail-msp21:00:003
24053992220,1cyclictest0-21swapper/323:35:213
24053992220,1cyclictest0-21swapper/322:10:393
24053992220,1cyclictest0-21swapper/322:10:393
24053992220,1cyclictest0-21swapper/321:40:243
24053992220,1cyclictest0-21swapper/300:30:443
2405399220,21cyclictest7074-21taskset22:03:213
2405399220,21cyclictest0-21swapper/321:11:033
2405399220,21cyclictest0-21swapper/300:21:043
24051992222,0cyclictest0-21swapper/223:07:212
24051992222,0cyclictest0-21swapper/222:20:202
24051992222,0cyclictest0-21swapper/200:25:082
24051992220,1cyclictest11363-21apt-get20:58:252
24051992219,0cyclictest0-21swapper/221:45:262
2405199220,22cyclictest0-21swapper/222:05:092
2405199220,21cyclictest22849-21sh20:15:002
2405199220,21cyclictest18082-21diskmemload21:56:222
2405199220,21cyclictest14129-21apt-get21:38:282
2405199220,21cyclictest11974-21ssh23:10:052
2405199220,21cyclictest0-21swapper/223:25:082
2405199220,21cyclictest0-21swapper/200:31:302
2405199220,21cyclictest0-21swapper/200:07:062
2405199220,1cyclictest5025-21sh22:32:402
2405199220,1cyclictest24049-21ssh22:50:232
2405199220,1cyclictest0-21swapper/222:00:162
2405199220,0cyclictest0-21swapper/222:47:002
2405199220,0cyclictest0-21swapper/221:10:432
24047992222,0cyclictest0-21swapper/121:56:201
24047992222,0cyclictest0-21swapper/121:50:141
24047992222,0cyclictest0-21swapper/121:21:131
24047992221,1cyclictest0-21swapper/100:20:241
24047992220,1cyclictest6884-21ssh23:05:131
24047992220,1cyclictest606-21dbus-daemon19:20:011
2404799220,22cyclictest8425-21perf19:45:011
2404799220,22cyclictest30013-21ssh22:56:411
2404799220,21cyclictest0-21swapper/123:55:411
2404799220,21cyclictest0-21swapper/121:03:281
2404799220,21cyclictest0-21swapper/120:08:271
2404799220,1cyclictest0-21swapper/122:47:471
24043992222,0cyclictest29346-21apt-get19:23:270
24043992221,1cyclictest18082-21diskmemload21:50:050
24043992220,1cyclictest0-21swapper/023:00:160
2404399220,22cyclictest0-21swapper/000:17:050
2404399220,21cyclictest18082-21diskmemload00:20:090
2404399220,21cyclictest16193-21apt-get20:03:270
2404399220,21cyclictest0-21swapper/019:58:280
2404399220,21cyclictest0-21swapper/000:03:250
2404399220,0cyclictest0-21swapper/021:59:510
24053992121,0cyclictest0-21swapper/319:58:283
24053992120,1cyclictest18082-21diskmemload23:46:313
24053992120,0cyclictest0-21swapper/320:23:273
24053992119,1cyclictest0-21swapper/319:55:013
2405399210,21cyclictest0-21swapper/323:00:013
2405399210,21cyclictest0-21swapper/300:10:153
2405399210,0cyclictest0-21swapper/319:13:293
24051992120,1cyclictest3788-21apt-get20:43:272
24051992120,1cyclictest31739-21apt-get19:28:282
24051992119,1cyclictest5667-21apt-get20:45:022
2405199210,21cyclictest0-21swapper/222:10:042
2405199210,21cyclictest0-21swapper/222:10:042
2405199210,0cyclictest8937-21apt-get19:48:292
2405199210,0cyclictest0-21swapper/200:37:092
2405199210,0cyclictest0-21swapper/200:10:412
24047992121,0cyclictest0-21swapper/120:48:281
24047992120,1cyclictest30988-21apt-get20:33:261
24047992120,1cyclictest18082-21diskmemload22:00:021
2404799210,0cyclictest18082-21diskmemload22:30:021
2404799210,0cyclictest0-21swapper/120:13:271
2404399210,21cyclictest0-21swapper/021:10:070
2404399210,0cyclictest0-21swapper/020:48:280
2404399210,0cyclictest0-21swapper/020:25:000
2404399210,0cyclictest0-21swapper/020:13:270
2404399210,0cyclictest0-21swapper/020:08:270
24053992020,0cyclictest0-21swapper/319:48:293
24053992020,0cyclictest0-21swapper/319:28:273
2405399200,19cyclictest0-21swapper/320:53:303
2405399200,0cyclictest0-21swapper/321:08:283
2405399200,0cyclictest0-21swapper/320:13:283
24051992020,0cyclictest6540-21apt-get19:43:272
24051992020,0cyclictest0-21swapper/220:33:262
24051992020,0cyclictest0-21swapper/220:20:022
24051992018,1cyclictest13836-21apt-get21:03:282
24047992020,0cyclictest0-21swapper/119:33:271
24047992020,0cyclictest0-21swapper/119:23:271
24047992019,1cyclictest0-21swapper/120:43:261
2404799200,20cyclictest0-21swapper/119:58:281
2404799200,0cyclictest0-21swapper/120:53:301
24043992020,0cyclictest8976-21apt-get20:53:300
24043992020,0cyclictest0-21swapper/020:28:260
24043992020,0cyclictest0-21swapper/019:53:270
24043992020,0cyclictest0-21swapper/019:13:290
24043992019,1cyclictest2869-21apt-get20:40:020
24043992019,0cyclictest0-21swapper/021:08:280
2404399200,20cyclictest0-21swapper/019:18:270
24053991919,0cyclictest0-21swapper/320:18:283
24051991919,0cyclictest0-21swapper/220:53:302
24051991917,1cyclictest13777-21apt-get19:58:282
24047991919,0cyclictest16229-21apt-get21:08:281
24047991919,0cyclictest0-21swapper/119:48:291
24047991919,0cyclictest0-21swapper/119:28:281
24047991917,1cyclictest2869-21apt-get20:40:011
24053991818,0cyclictest0-21swapper/320:33:263
24053991818,0cyclictest0-21swapper/320:10:003
24053991818,0cyclictest0-21swapper/319:33:273
24053991816,1cyclictest15705-21latency_hist21:05:003
24051991818,0cyclictest0-21swapper/220:28:262
24051991818,0cyclictest0-21swapper/219:23:272
24051991817,1cyclictest23377-21apt-get20:18:282
24047991816,1cyclictest25265-21apt-get20:20:001
24043991818,0cyclictest0-21swapper/019:50:010
24043991817,1cyclictest0-21swapper/019:28:270
24043991817,0cyclictest11363-21apt-get20:58:250
2404399180,17cyclictest1691-21/usr/sbin/munin19:33:330
24053991717,0cyclictest0-21swapper/320:03:273
24053991716,1cyclictest8462-21perf20:50:013
24053991716,1cyclictest0-21swapper/319:18:273
24051991717,0cyclictest0-21swapper/219:38:262
24051991717,0cyclictest0-21swapper/219:33:272
24047991717,0cyclictest0-21swapper/120:23:271
24043991716,0cyclictest0-21swapper/020:18:280
24051991616,0cyclictest0-21swapper/219:18:272
2405199160,15cyclictest0-21swapper/220:10:002
24047991616,0cyclictest0-21swapper/120:28:261
24047991515,0cyclictest0-21swapper/119:38:261
24043991513,1cyclictest15707-21apt21:05:000
24053991414,0cyclictest0-21swapper/320:36:123
24053991414,0cyclictest0-21swapper/320:26:373
2405399140,14cyclictest0-21swapper/320:41:043
2405399140,14cyclictest0-21swapper/319:41:403
2405399140,14cyclictest0-21swapper/319:35:373
24051991414,0cyclictest0-21swapper/220:00:542
2405199140,14cyclictest0-21swapper/221:06:132
2405199140,0cyclictest0-21swapper/220:35:232
2405199140,0cyclictest0-21swapper/219:11:332
24047991414,0cyclictest0-21swapper/119:11:281
2404799140,14cyclictest0-21swapper/120:00:011
2404799140,0cyclictest0-21swapper/119:50:361
24043991414,0cyclictest0-21swapper/020:36:300
2404399140,14cyclictest0-21swapper/019:35:190
2404399140,0cyclictest0-21swapper/019:42:370
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional