You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 04:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Tue May 05, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
158102119108,6sleep20-21swapper/219:09:412
15740210884,19sleep00-21swapper/019:08:470
15659210796,6sleep10-21swapper/119:07:441
15646210688,12sleep30-21swapper/319:07:343
46012650,0sleep30-21swapper/300:14:303
212862650,1sleep337-21rcuc/320:41:003
146342640,0sleep30-21swapper/322:00:393
14952610,1sleep20-21swapper/222:58:422
81992260,0sleep00-21swapper/020:10:120
236502250,1sleep10-21swapper/100:35:131
1586199241,21cyclictest0-21swapper/022:35:110
1586199220,7cyclictest0-21swapper/022:05:110
1586399210,19cyclictest0-21swapper/220:55:122
1586299210,2cyclictest0-21swapper/120:40:111
1586199211,18cyclictest0-21swapper/022:40:120
15861992111,8cyclictest0-21swapper/022:00:160
1586199210,19cyclictest3972-21rm21:14:310
1586199210,19cyclictest0-21swapper/023:25:410
115902210,0sleep30-21swapper/321:57:343
50152200,1sleep30-21swapper/323:01:353
1586299200,18cyclictest20807-21rm23:20:111
1586199202,12cyclictest0-21swapper/021:45:010
1586199200,18cyclictest0-21swapper/023:30:140
1586199200,18cyclictest0-21swapper/021:22:170
1586199200,18cyclictest0-21swapper/000:35:320
1586199200,18cyclictest0-21swapper/000:11:150
1586499190,4cyclictest15901-21ssh00:26:043
1586299190,2cyclictest0-21swapper/121:15:171
15861991911,7cyclictest0-21swapper/022:11:010
1586199190,8cyclictest0-21swapper/022:56:350
1586199190,18cyclictest0-21swapper/023:46:410
1586199190,18cyclictest0-21swapper/023:05:020
1586199190,17cyclictest0-21swapper/022:32:510
1586199190,17cyclictest0-21swapper/021:52:230
1586199190,17cyclictest0-21swapper/021:32:270
1586199190,17cyclictest0-21swapper/000:19:360
87542180,1sleep00-21swapper/021:55:110
15864991815,2cyclictest4015-21kworker/u8:021:19:043
15863991815,2cyclictest32464-21kworker/u8:223:34:042
15863991815,2cyclictest24626-21kworker/u8:023:50:042
15863991815,2cyclictest20348-21kworker/u8:122:45:042
1586199182,13cyclictest0-21swapper/020:27:590
1586199180,6cyclictest32007-21diskmemload00:27:110
1586199180,17cyclictest0-21swapper/023:54:270
1586199180,17cyclictest0-21swapper/022:48:120
1586199180,17cyclictest0-21swapper/021:27:540
1586199180,17cyclictest0-21swapper/021:27:540
1586199180,17cyclictest0-21swapper/000:30:160
1586199180,17cyclictest0-21swapper/000:03:230
1586199180,16cyclictest0-21swapper/023:57:390
1586199180,16cyclictest0-21swapper/023:41:260
1586199180,16cyclictest0-21swapper/022:26:300
1586199180,16cyclictest0-21swapper/022:19:120
1586199180,16cyclictest0-21swapper/000:20:280
1586499171,2cyclictest28456-21ssh22:16:043
15864991712,3cyclictest0-21swapper/322:10:003
15863991714,2cyclictest4015-21kworker/u8:021:14:052
15863991714,2cyclictest4015-21kworker/u8:021:05:042
15863991714,2cyclictest4015-21kworker/u8:020:37:042
15863991714,2cyclictest30015-21kworker/u8:119:53:042
15863991714,2cyclictest26220-21kworker/u8:219:41:042
15863991714,2cyclictest24920-21kworker/u8:022:22:042
15863991714,2cyclictest24626-21kworker/u8:023:56:042
15863991714,2cyclictest1938-21kworker/u8:221:48:012
15863991714,2cyclictest12202-21kworker/u8:120:41:042
1586199179,7cyclictest0-21swapper/023:13:470
1586199171,14cyclictest5839-21cron20:05:000
15861991710,6cyclictest0-21swapper/019:10:130
1586199170,16cyclictest0-21swapper/023:20:020
1586199170,16cyclictest0-21swapper/021:05:210
1586199170,15cyclictest32007-21diskmemload00:05:070
1586199170,15cyclictest28243-21ssh22:51:480
1586199170,15cyclictest0-21swapper/023:18:340
1586199170,15cyclictest0-21swapper/021:15:240
15864991613,2cyclictest9986-21kworker/u8:123:31:043
15864991613,2cyclictest20348-21kworker/u8:122:48:043
15864991612,3cyclictest9986-21kworker/u8:123:17:043
15864991611,3cyclictest0-21swapper/323:10:153
15864991611,3cyclictest0-21swapper/320:16:043
15863991614,1cyclictest11132-21ssh23:45:112
15863991613,2cyclictest4015-21kworker/u8:020:54:042
15863991613,2cyclictest4015-21kworker/u8:020:08:012
15863991613,2cyclictest32464-21kworker/u8:223:43:042
15863991613,2cyclictest30155-21kworker/u8:222:26:052
15863991613,2cyclictest27684-21kworker/u8:221:00:042
15863991613,2cyclictest26220-21kworker/u8:219:45:042
15863991613,2cyclictest20141-21kworker/u8:119:30:052
15863991613,2cyclictest19430-21kworker/u8:223:19:042
15863991613,2cyclictest18397-21kworker/u8:200:04:052
15863991613,2cyclictest15380-21kworker/u8:222:41:042
15863991613,2cyclictest12202-21kworker/u8:120:27:042
15863991613,2cyclictest12202-21kworker/u8:120:22:042
15863991613,2cyclictest12048-21kworker/u8:019:36:052
15863991613,2cyclictest12048-21kworker/u8:019:25:042
15862991610,4cyclictest0-21swapper/123:30:181
1586199169,6cyclictest0-21swapper/023:37:210
1586199169,6cyclictest0-21swapper/021:36:150
1586199168,7cyclictest0-21swapper/023:01:220
1586199161,13cyclictest18144-21aten2.4_r3power19:15:120
1586199160,15cyclictest0-21swapper/019:58:220
1586499151,12cyclictest22418-21apt-get22:10:113
15864991510,3cyclictest27446-21ssh00:03:493
1586499150,2cyclictest0-21swapper/322:35:043
15863991512,2cyclictest397-21kworker/u8:200:12:042
15863991512,2cyclictest32464-21kworker/u8:223:36:012
15863991512,2cyclictest26220-21kworker/u8:220:03:042
15863991512,2cyclictest24920-21kworker/u8:023:00:042
15863991512,2cyclictest24626-21kworker/u8:023:27:042
15863991512,2cyclictest2239-21kworker/u8:221:35:042
15863991512,2cyclictest2239-21kworker/u8:221:30:052
15863991512,2cyclictest2239-21kworker/u8:221:22:042
15863991512,2cyclictest16409-21kworker/u8:121:53:042
15863991512,2cyclictest16409-21kworker/u8:121:29:042
15863991512,2cyclictest16409-21kworker/u8:121:29:042
15863991512,2cyclictest13349-21kworker/u8:122:05:042
15863991511,2cyclictest0-21swapper/219:15:062
1586299158,5cyclictest0-21swapper/100:20:061
15862991511,2cyclictest0-21swapper/121:35:061
1586299150,14cyclictest0-21swapper/123:11:041
1586199154,9cyclictest32007-21diskmemload22:20:540
1586199153,10cyclictest32279-21cut19:50:120
1586199153,10cyclictest28798-21fschecks_time19:40:130
1586199153,10cyclictest23841-21chrt20:48:340
15861991510,3cyclictest0-21swapper/020:16:030
1586199150,14cyclictest0-21swapper/020:55:390
1586199150,13cyclictest30468-21munin-node0
1586199150,13cyclictest0-21swapper/019:30:190
1586199150,12cyclictest0-21swapper/019:37:020
1586499149,3cyclictest0-21swapper/323:44:223
1586499141,3cyclictest7678-21ssh00:17:103
15864991411,2cyclictest0-21swapper/322:55:113
15864991411,2cyclictest0-21swapper/321:41:013
1586499141,11cyclictest13822-21ssh21:25:073
1586499141,11cyclictest13822-21ssh21:25:073
15864991410,2cyclictest14887-21memory20:25:163
1586499140,13cyclictest0-21swapper/319:11:013
1586499140,12cyclictest27498-21ssh22:51:043
1586499140,12cyclictest0-21swapper/320:01:063
1586399141,2cyclictest12-21rcu_preempt22:36:012
15863991411,2cyclictest7896-21kworker/u8:021:55:042
15863991411,2cyclictest4015-21kworker/u8:021:18:042
15863991411,2cyclictest4015-21kworker/u8:020:34:042
15863991411,2cyclictest4015-21kworker/u8:020:12:012
15863991411,2cyclictest30015-21kworker/u8:119:56:042
15863991411,2cyclictest28024-21kworker/u8:000:05:042
15863991411,2cyclictest20348-21kworker/u8:122:53:042
15863991411,2cyclictest18883-21kworker/u8:000:32:042
15863991411,2cyclictest16409-21kworker/u8:121:40:042
15863991411,2cyclictest12202-21kworker/u8:120:48:042
15863991411,2cyclictest12048-21kworker/u8:019:22:042
1586399140,12cyclictest13811-21ssh00:24:462
1586399140,12cyclictest11040-21ssh22:33:032
1586299140,12cyclictest0-21swapper/123:05:201
1586199143,9cyclictest29999-21latency_hist21:05:000
1586199143,9cyclictest27991-21cpuspeed_turbos21:40:130
1586199143,9cyclictest24428-21tr20:50:140
1586199143,9cyclictest18657-21grep20:35:130
1586199142,7cyclictest0-21swapper/020:10:000
1586199141,11cyclictest3728-21runrttasks19:20:120
1586199141,11cyclictest23982-21http19:30:000
1586199141,10cyclictest0-21swapper/020:20:010
1586199140,12cyclictest0-21swapper/020:30:120
1586499138,3cyclictest20792-21ssh23:20:113
15864991310,2cyclictest4015-21kworker/u8:020:11:043
15864991310,2cyclictest32391-21telnet21:10:113
15864991310,2cyclictest0-21swapper/322:30:173
15864991310,2cyclictest0-21swapper/321:50:003
15864991310,2cyclictest0-21swapper/321:38:303
15864991310,2cyclictest0-21swapper/321:20:113
15864991310,2cyclictest0-21swapper/320:45:123
15864991310,2cyclictest0-21swapper/300:35:123
1586499130,2cyclictest0-21swapper/322:20:173
1586499130,2cyclictest0-21swapper/319:15:133
1586499130,12cyclictest0-21swapper/319:36:023
1586499130,11cyclictest0-21swapper/300:20:043
15863991310,2cyclictest2715-21kworker/u8:223:12:042
15863991310,2cyclictest0-21swapper/220:15:142
1586399130,2cyclictest0-21swapper/200:35:282
1586399130,2cyclictest0-21swapper/200:25:132
15862991310,2cyclictest28211-21apt-get21:00:111
15862991310,2cyclictest0-21swapper/123:01:001
15862991310,2cyclictest0-21swapper/121:05:211
15862991310,2cyclictest0-21swapper/120:30:171
15862991310,2cyclictest0-21swapper/119:25:171
1586299130,8cyclictest4556-21metacity20:56:591
1586299130,2cyclictest32007-21diskmemload22:47:301
1586299130,2cyclictest0-21swapper/122:36:301
1586299130,2cyclictest0-21swapper/121:43:001
1586299130,2cyclictest0-21swapper/100:30:101
1586299130,2cyclictest0-21swapper/100:11:031
1586299130,12cyclictest32007-21diskmemload23:57:301
1586299130,12cyclictest0-21swapper/123:45:151
1586299130,12cyclictest0-21swapper/122:00:171
1586299130,12cyclictest0-21swapper/121:23:391
1586299130,11cyclictest8002-21cut23:40:501
1586299130,11cyclictest25238-21cut19:30:291
1586299130,11cyclictest0-21swapper/120:05:291
1586199131,10cyclictest20176-21aten2.4_r3power20:40:110
188092120,2sleep10-21swapper/122:41:101
1586499129,2cyclictest4015-21kworker/u8:021:09:043
1586499129,2cyclictest32007-21diskmemload23:07:183
1586499129,2cyclictest26220-21kworker/u8:220:05:043
1586499129,2cyclictest26220-21kworker/u8:219:42:013
1586499129,2cyclictest16409-21kworker/u8:121:30:013
1586499129,2cyclictest0-21swapper/323:59:113
1586499129,2cyclictest0-21swapper/323:25:153
1586499129,2cyclictest0-21swapper/320:55:183
1586499129,2cyclictest0-21swapper/319:31:013
1586499128,2cyclictest11080-21ssh23:45:073
1586499120,2cyclictest32007-21diskmemload23:37:533
1586499120,2cyclictest0-21swapper/322:40:063
1586499120,2cyclictest0-21swapper/320:31:023
1586499120,11cyclictest0-21swapper/323:50:173
1586499120,11cyclictest0-21swapper/300:32:003
1586499120,11cyclictest0-21swapper/300:06:383
1586499120,10cyclictest32007-21diskmemload21:51:283
1586399129,2cyclictest13349-21kworker/u8:122:15:042
1586399129,2cyclictest0-21swapper/223:05:382
1586399120,2cyclictest0-21swapper/222:00:352
1586399120,11cyclictest0-21swapper/223:20:092
1586399120,11cyclictest0-21swapper/222:10:132
1586399120,11cyclictest0-21swapper/200:18:092
1586299129,2cyclictest0-21swapper/122:53:371
1586299129,2cyclictest0-21swapper/122:30:411
1586299129,2cyclictest0-21swapper/122:21:121
1586299129,2cyclictest0-21swapper/121:11:431
1586299129,2cyclictest0-21swapper/120:25:151
1586299121,7cyclictest4556-21metacity20:19:001
1586299121,7cyclictest4556-21metacity19:24:591
1586299120,2cyclictest0-21swapper/123:51:181
1586299120,2cyclictest0-21swapper/122:15:131
1586299120,2cyclictest0-21swapper/120:20:171
1586299120,2cyclictest0-21swapper/120:00:131
1586299120,2cyclictest0-21swapper/119:40:131
1586299120,2cyclictest0-21swapper/100:29:151
1586299120,11cyclictest32007-21diskmemload00:02:101
1586299120,11cyclictest0-21swapper/123:25:201
1586299120,11cyclictest0-21swapper/123:15:131
1586299120,11cyclictest0-21swapper/122:25:121
1586299120,11cyclictest0-21swapper/122:06:021
1586299120,11cyclictest0-21swapper/121:55:011
1586299120,11cyclictest0-21swapper/121:47:221
1586299120,11cyclictest0-21swapper/121:29:331
1586299120,11cyclictest0-21swapper/121:29:331
1586299120,11cyclictest0-21swapper/119:35:131
1586299120,11cyclictest0-21swapper/100:19:481
1586299120,11cyclictest0-21swapper/100:09:121
1586299120,10cyclictest0-21swapper/120:35:391
1586499118,2cyclictest4015-21kworker/u8:020:36:053
1586499112,5cyclictest0-21swapper/319:51:303
1586499111,7cyclictest4562-21gdm-simple-gree19:22:583
1586499110,9cyclictest0-21swapper/322:25:353
1586499110,9cyclictest0-21swapper/320:55:003
1586499110,10cyclictest0-21swapper/321:01:013
1586399117,3cyclictest12048-21kworker/u8:019:11:042
1586299118,2cyclictest4304-21munin-node1
1586299118,2cyclictest0-21swapper/121:32:091
1586299118,2cyclictest0-21swapper/119:55:121
1586299118,2cyclictest0-21swapper/119:10:141
1586299117,2cyclictest0-21swapper/119:50:171
1586299112,7cyclictest0-21swapper/119:18:591
1586299110,2cyclictest0-21swapper/123:35:181
1586299110,10cyclictest0-21swapper/122:57:281
1586299110,10cyclictest0-21swapper/122:10:451
1586499107,2cyclictest21936-21apt-get19:25:043
1586299100,7cyclictest0-21swapper/120:53:591
1586299100,7cyclictest0-21swapper/120:45:011
158649996,2cyclictest26220-21kworker/u8:220:20:043
158649994,3cyclictest30762-21cut19:45:143
158649994,3cyclictest1919-21basename19:55:123
158629990,8cyclictest4015-21kworker/u8:020:10:041
158629990,7cyclictest0-21swapper/119:45:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional