You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-22 - 08:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Tue Sep 22, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10215211594,16sleep00-21swapper/019:08:420
101512113102,6sleep30-21swapper/319:07:533
10194210991,13sleep10-21swapper/119:08:271
10262210584,16sleep20-21swapper/219:09:202
21072800,1sleep02110-21grep20:10:160
181362770,1sleep121-21rcuc/122:46:351
232612760,1sleep00-21swapper/022:52:140
220842750,1sleep30-21swapper/323:25:363
283672700,0sleep20-21swapper/222:57:582
114962690,0sleep00-21swapper/023:15:070
199702640,0sleep10-21swapper/121:40:011
310042560,1sleep20-21swapper/223:00:172
10343993617,18cyclictest0-21swapper/121:10:131
3082340,1sleep00-21swapper/020:05:180
10344992926,2cyclictest7757-21kworker/u8:000:23:052
10344992825,2cyclictest998-21kworker/u8:200:39:052
10344992825,2cyclictest998-21kworker/u8:200:19:042
10344992825,2cyclictest9589-21kworker/u8:223:53:042
10344992825,2cyclictest6394-21kworker/u8:023:13:042
10344992825,2cyclictest30315-21kworker/u8:023:48:062
10345992724,2cyclictest14601-21kworker/u8:122:48:053
10345992724,2cyclictest14035-21kworker/u8:221:33:053
10344992724,2cyclictest6541-21kworker/u8:222:08:052
10344992724,2cyclictest22966-21kworker/u8:000:04:012
10344992724,2cyclictest16800-21kworker/u8:100:09:042
10344992623,2cyclictest8246-21kworker/u8:021:29:042
10344992623,2cyclictest6541-21kworker/u8:222:10:042
10344992623,2cyclictest6541-21kworker/u8:222:02:042
10344992623,2cyclictest32047-21kworker/u8:021:19:042
1034499262,18cyclictest0-21swapper/222:52:042
1034399260,2cyclictest0-21swapper/120:20:121
10344992522,2cyclictest19261-21kworker/u8:021:42:042
10344992522,2cyclictest14601-21kworker/u8:122:48:022
10344992421,2cyclictest6394-21kworker/u8:023:28:042
10344992421,2cyclictest24926-21kworker/u8:223:30:052
10344992421,2cyclictest19888-21kworker/u8:123:39:042
10344992421,2cyclictest1921-21kworker/u8:321:22:022
10344992421,2cyclictest11686-21kworker/u8:223:22:052
10344992420,3cyclictest32668-21kworker/u8:122:15:052
10345992319,2cyclictest30315-21kworker/u8:023:42:053
10344992320,2cyclictest19261-21kworker/u8:021:55:052
10345992219,2cyclictest7757-21kworker/u8:000:30:053
10345992219,2cyclictest32668-21kworker/u8:122:12:043
10344992219,2cyclictest9589-21kworker/u8:223:55:052
10344992219,2cyclictest8246-21kworker/u8:021:31:052
10344992219,2cyclictest7757-21kworker/u8:000:31:042
10344992219,2cyclictest7751-21kworker/u8:120:40:052
10344992219,2cyclictest22966-21kworker/u8:000:12:062
308232210,1sleep3381ktimersoftd/320:00:203
10345992118,2cyclictest22083-21kworker/u8:223:02:053
10345992118,2cyclictest19261-21kworker/u8:021:49:053
10345992118,2cyclictest19261-21kworker/u8:021:49:043
10344992118,2cyclictest3633-21kworker/u8:020:17:042
10344992118,2cyclictest30315-21kworker/u8:023:40:012
10344992118,2cyclictest1050-21kworker/u8:220:09:052
10345992017,2cyclictest6541-21kworker/u8:222:43:053
10345992017,2cyclictest6394-21kworker/u8:023:12:043
10344992017,2cyclictest3633-21kworker/u8:020:28:042
10344992017,2cyclictest27226-21kworker/u8:221:13:052
10344992017,2cyclictest23937-21kworker/u8:019:52:042
10344992017,2cyclictest14269-21kworker/u8:019:25:042
1034499200,18cyclictest0-21swapper/221:37:052
1034299200,15cyclictest0-21swapper/023:54:040
10345991916,2cyclictest7757-21kworker/u8:000:27:043
10345991916,2cyclictest28139-21kworker/u8:122:28:013
10345991916,2cyclictest2042-21kworker/u8:022:39:043
10345991916,2cyclictest19261-21kworker/u8:021:50:063
10345991916,2cyclictest16800-21kworker/u8:123:58:053
10344991916,2cyclictest7751-21kworker/u8:120:50:042
10344991916,2cyclictest3633-21kworker/u8:021:06:052
10344991916,2cyclictest3633-21kworker/u8:021:02:042
10344991916,2cyclictest3633-21kworker/u8:020:23:052
10344991916,2cyclictest23937-21kworker/u8:020:04:042
1034499190,18cyclictest0-21swapper/222:40:052
1034499190,18cyclictest0-21swapper/222:36:042
1034499190,18cyclictest0-21swapper/220:55:052
10342991915,2cyclictest15716-21ssh21:35:110
1034299190,17cyclictest0-21swapper/000:20:040
243222180,0sleep00-21swapper/023:28:370
10345991815,2cyclictest9589-21kworker/u8:223:52:043
10345991815,2cyclictest8246-21kworker/u8:021:28:013
10345991815,2cyclictest22966-21kworker/u8:000:01:043
10345991815,2cyclictest22083-21kworker/u8:223:07:053
10345991815,2cyclictest22083-21kworker/u8:222:58:053
10345991815,2cyclictest14601-21kworker/u8:122:50:043
10345991815,2cyclictest11686-21kworker/u8:223:23:053
10344991815,2cyclictest8218-21kworker/u8:219:33:052
10344991815,2cyclictest7751-21kworker/u8:120:47:052
10344991815,2cyclictest2969-21kworker/u8:019:10:042
10344991815,2cyclictest19967-21kworker/u8:119:36:052
10345991714,2cyclictest6541-21kworker/u8:222:19:053
10345991714,2cyclictest19261-21kworker/u8:021:41:043
10345991714,2cyclictest14035-21kworker/u8:221:38:043
1034499172,2cyclictest0-21swapper/223:08:052
10344991714,2cyclictest12219-21kworker/u8:119:19:052
1034499171,3cyclictest15931-21munin-run23:19:592
1034299172,9cyclictest4556-21metacity22:56:590
10345991613,2cyclictest7751-21kworker/u8:120:56:063
10345991613,2cyclictest6541-21kworker/u8:222:09:053
10345991613,2cyclictest3633-21kworker/u8:020:24:053
10345991613,2cyclictest20431-21kworker/u8:022:22:043
10345991613,2cyclictest19888-21kworker/u8:123:33:053
1034499161,3cyclictest0-21swapper/222:21:012
10343991611,3cyclictest0-21swapper/123:49:121
1034399160,14cyclictest6262-21sh21:24:521
1034399160,14cyclictest24901-21diskmemload22:42:011
1034299169,5cyclictest12211-21sendmail-mta19:17:040
1034299161,10cyclictest0-21swapper/022:06:020
127002151,3sleep112764-21sed21:31:071
10345991512,2cyclictest9589-21kworker/u8:223:47:053
10345991512,2cyclictest7751-21kworker/u8:120:48:023
10345991512,2cyclictest6541-21kworker/u8:222:33:053
10345991512,2cyclictest32668-21kworker/u8:121:58:043
10345991512,2cyclictest23937-21kworker/u8:020:05:053
10345991512,2cyclictest22966-21kworker/u8:000:05:053
10345991512,2cyclictest1921-21kworker/u8:321:22:063
10345991512,2cyclictest14269-21kworker/u8:019:24:043
1034599151,12cyclictest20502-21munin-node3
1034599150,13cyclictest25979-21latency_hist00:40:013
1034499150,2cyclictest0-21swapper/222:34:052
1034499150,2cyclictest0-21swapper/222:25:042
1034499150,2cyclictest0-21swapper/220:39:042
10343991512,2cyclictest0-21swapper/123:02:311
1034399151,12cyclictest24447-21hddtemp_smartct19:45:151
10343991510,3cyclictest27553-21taskset22:56:341
1034399150,13cyclictest12562-21sh22:06:021
1034399150,13cyclictest0-21swapper/122:23:381
10342991511,2cyclictest0-21swapper/020:55:200
10345991411,2cyclictest998-21kworker/u8:200:17:043
1034599140,2cyclictest0-21swapper/323:18:053
1034599140,2cyclictest0-21swapper/322:03:043
10344991410,2cyclictest29-21rcuc/221:45:122
10344991410,2cyclictest29-21rcuc/221:45:112
1034499140,2cyclictest0-21swapper/220:34:052
1034499140,2cyclictest0-21swapper/200:26:042
1034399149,3cyclictest19042-21sh23:22:291
1034399141,2cyclictest24901-21diskmemload22:35:221
10343991411,2cyclictest24901-21diskmemload21:16:311
10343991411,2cyclictest0-21swapper/122:12:011
10343991411,2cyclictest0-21swapper/122:00:151
10343991411,2cyclictest0-21swapper/121:46:521
10343991411,2cyclictest0-21swapper/121:46:511
1034399141,11cyclictest2126-21apt-get22:30:151
1034399140,2cyclictest0-21swapper/122:53:211
1034399140,2cyclictest0-21swapper/122:26:411
1034399140,2cyclictest0-21swapper/100:16:011
1034399140,12cyclictest14237-21ssh23:51:281
1034399140,12cyclictest0-21swapper/100:30:051
10342991411,2cyclictest0-21swapper/022:45:200
10342991410,2cyclictest353-21ssh00:11:330
10342991410,2cyclictest0-21swapper/000:00:030
1034299140,2cyclictest0-21swapper/022:43:490
1034299140,12cyclictest0-21swapper/023:46:090
1034299140,12cyclictest0-21swapper/023:10:120
1034299140,12cyclictest0-21swapper/021:30:120
316442130,1sleep00-21swapper/021:16:230
1034599138,3cyclictest31281-21pzem_current23:35:183
1034599132,7cyclictest0-21swapper/319:15:003
1034599132,6cyclictest0-21swapper/319:20:013
1034599131,6cyclictest0-21swapper/319:45:003
1034599131,10cyclictest18783-21fw_packets19:30:163
10345991310,2cyclictest7751-21kworker/u8:120:54:043
10345991310,2cyclictest3633-21kworker/u8:021:10:053
10345991310,2cyclictest3633-21kworker/u8:020:43:053
10345991310,2cyclictest0-21swapper/321:15:123
1034599130,9cyclictest0-21swapper/321:07:053
1034599130,3cyclictest27533-21sendmail-mta19:54:203
1034599130,2cyclictest0-21swapper/300:13:053
1034499130,2cyclictest0-21swapper/219:57:052
1034499130,2cyclictest0-21swapper/219:44:052
10343991311,1cyclictest0-21swapper/121:56:181
10343991310,2cyclictest0-21swapper/123:58:421
10343991310,2cyclictest0-21swapper/123:36:181
10343991310,2cyclictest0-21swapper/123:30:151
10343991310,2cyclictest0-21swapper/121:42:541
10343991310,2cyclictest0-21swapper/121:05:111
10343991310,2cyclictest0-21swapper/119:55:171
10343991310,2cyclictest0-21swapper/119:30:201
10343991310,2cyclictest0-21swapper/119:15:161
10343991310,2cyclictest0-21swapper/100:03:081
1034399130,2cyclictest0-21swapper/123:06:521
1034399130,2cyclictest0-21swapper/120:10:131
1034399130,2cyclictest0-21swapper/100:36:371
1034399130,12cyclictest0-21swapper/121:26:411
1034399130,11cyclictest0-21swapper/123:15:381
1034399130,11cyclictest0-21swapper/122:15:071
10342991310,2cyclictest7838-21ssh21:25:300
10342991310,2cyclictest22150irq/25-ahci[00021:56:090
10342991310,2cyclictest18450-21ssh00:30:580
10342991310,2cyclictest0-21swapper/023:36:500
10342991310,2cyclictest0-21swapper/023:05:310
10342991310,2cyclictest0-21swapper/023:04:100
10342991310,2cyclictest0-21swapper/022:36:500
10342991310,2cyclictest0-21swapper/022:34:290
10342991310,2cyclictest0-21swapper/022:20:100
10342991310,2cyclictest0-21swapper/022:15:360
10342991310,2cyclictest0-21swapper/020:15:180
10342991310,2cyclictest0-21swapper/000:37:090
10342991310,2cyclictest0-21swapper/000:15:150
10342991310,2cyclictest0-21swapper/000:06:550
1034299130,2cyclictest28005-21sh21:48:110
1034299130,2cyclictest28005-21sh21:48:110
1034299130,2cyclictest18358-21ntp_states20:50:170
1034299130,2cyclictest0-21swapper/023:23:000
1034299130,2cyclictest0-21swapper/021:13:450
1034299130,2cyclictest0-21swapper/020:20:180
1034299130,12cyclictest31126-21ssh22:25:390
1034299130,12cyclictest0-21swapper/023:55:550
1034299130,12cyclictest0-21swapper/023:30:240
1034299130,12cyclictest0-21swapper/022:14:320
1034299130,11cyclictest2294-21fschecks_count21:20:150
1034299130,11cyclictest0-21swapper/022:02:070
1034599129,2cyclictest8218-21kworker/u8:219:48:043
1034599129,2cyclictest3633-21kworker/u8:021:04:013
1034599129,2cyclictest3633-21kworker/u8:020:25:043
1034599129,2cyclictest14269-21kworker/u8:019:27:053
1034599129,2cyclictest1050-21kworker/u8:220:15:053
1034599129,2cyclictest1050-21kworker/u8:220:13:043
1034599129,2cyclictest0-21swapper/300:23:223
1034399129,2cyclictest0-21swapper/123:40:151
1034399129,2cyclictest0-21swapper/123:14:061
1034399129,2cyclictest0-21swapper/120:05:591
1034399129,2cyclictest0-21swapper/100:25:311
1034399129,2cyclictest0-21swapper/100:20:181
1034399128,2cyclictest0-21swapper/120:55:181
1034399128,2cyclictest0-21swapper/100:07:281
1034399122,7cyclictest0-21swapper/121:51:581
1034399121,9cyclictest14136-21grep20:40:131
1034399121,8cyclictest4556-21metacity19:23:591
1034399120,2cyclictest0-21swapper/120:30:171
1034399120,2cyclictest0-21swapper/119:26:461
1034399120,11cyclictest0-21swapper/123:26:571
1034399120,11cyclictest0-21swapper/100:10:391
1034299129,2cyclictest0-21swapper/021:01:020
1034299129,2cyclictest0-21swapper/020:40:040
1034299129,2cyclictest0-21swapper/000:26:090
1034299120,2cyclictest0-21swapper/023:40:570
1034299120,2cyclictest0-21swapper/021:51:400
1034299120,11cyclictest0-21swapper/021:44:350
1034299120,11cyclictest0-21swapper/021:05:390
1034299120,11cyclictest0-21swapper/019:40:140
1034299120,11cyclictest0-21swapper/019:10:150
1034599118,2cyclictest3633-21kworker/u8:020:33:053
1034599110,10cyclictest0-21swapper/320:36:003
1034599110,10cyclictest0-21swapper/319:55:173
1034499111,6cyclictest0-21swapper/219:20:172
1034499110,10cyclictest0-21swapper/221:51:062
1034399111,8cyclictest29951-21apt-get20:00:141
1034399111,8cyclictest17854-21diskstats20:50:131
1034399111,7cyclictest4562-21gdm-simple-gree19:36:581
1034399110,9cyclictest0-21swapper/119:50:131
1034399110,3cyclictest21101-21munin-node1
1034299118,2cyclictest0-21swapper/019:45:490
1034299112,6cyclictest0-21swapper/020:29:010
1034299110,10cyclictest0-21swapper/020:35:360
1034499107,2cyclictest0-21swapper/219:45:162
1034399107,2cyclictest0-21swapper/120:35:051
1034399100,8cyclictest0-21swapper/119:10:131
1034399100,7cyclictest0-21swapper/120:45:021
1034399100,7cyclictest0-21swapper/120:19:581
1034299107,2cyclictest15843-21munin-node0
1034299107,2cyclictest0-21swapper/019:50:000
1034299104,2cyclictest0-21swapper/019:21:050
1034299100,9cyclictest27670-21apt-get19:55:050
1034299100,9cyclictest0-21swapper/019:35:420
1034299100,2cyclictest0-21swapper/020:33:370
1034299100,2cyclictest0-21swapper/020:03:300
1034299100,2cyclictest0-21swapper/019:25:580
103449990,2cyclictest3728-21runrttasks20:11:042
103439991,6cyclictest8534-21munin-node1
103439991,6cyclictest0-21swapper/119:40:181
103429996,2cyclictest0-21swapper/019:34:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional