You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 05:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Apr 23, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
74932122111,6sleep10-21swapper/119:08:501
7513211593,17sleep00-21swapper/019:09:040
6832210788,14sleep30-21swapper/319:05:353
579429280,6sleep20-21swapper/219:05:072
280072760,0sleep00-21swapper/000:01:340
103042730,0sleep123-21ksoftirqd/122:02:151
256262700,0sleep20-21swapper/221:45:132
100842690,0sleep00-21swapper/022:01:550
241972570,1sleep20-21swapper/222:16:232
761499390,32cyclictest0-21swapper/023:35:120
7616993617,2cyclictest0-21swapper/219:45:112
761499360,18cyclictest0-21swapper/019:40:110
185962250,2sleep09-21ksoftirqd/019:35:150
175562240,1sleep2301ktimersoftd/223:50:462
761799211,2cyclictest0-21swapper/323:50:123
761799210,2cyclictest0-21swapper/323:05:123
761599210,2cyclictest0-21swapper/123:50:111
761499210,19cyclictest0-21swapper/000:15:100
761799200,2cyclictest0-21swapper/321:25:113
761799200,2cyclictest0-21swapper/320:35:123
761599202,4cyclictest0-21swapper/100:30:041
761499200,2cyclictest0-21swapper/019:45:110
761599192,2cyclictest0-21swapper/122:29:041
7615991916,2cyclictest7926-21kworker/u8:119:52:041
7615991916,2cyclictest7686-21kworker/u8:020:39:041
7615991916,2cyclictest22086-21kworker/u8:019:47:041
7615991916,2cyclictest19457-21kworker/u8:219:37:041
7615991916,2cyclictest17457-21kworker/u8:121:09:041
761599190,4cyclictest0-21swapper/123:36:051
7614991914,3cyclictest18642-21ssh22:45:120
7615991815,2cyclictest9228-21kworker/u8:022:09:041
7615991815,2cyclictest7926-21kworker/u8:120:22:051
7615991815,2cyclictest7926-21kworker/u8:120:12:011
7615991815,2cyclictest7686-21kworker/u8:020:42:041
7615991815,2cyclictest25154-21kworker/u8:000:09:041
7615991815,2cyclictest23497-21kworker/u8:223:24:051
7615991815,2cyclictest20989-21kworker/u8:019:20:051
7615991815,2cyclictest17457-21kworker/u8:121:02:041
7615991815,2cyclictest14765-21kworker/u8:220:48:021
761599181,2cyclictest0-21swapper/121:19:041
7617991712,3cyclictest15678-21ssh21:35:103
7616991714,2cyclictest26303-21kworker/u8:221:28:042
7616991712,3cyclictest28216-21ssh22:55:112
7615991714,2cyclictest12-21rcu_preempt21:50:111
7615991714,2cyclictest10293-21kworker/u8:021:48:041
761599171,2cyclictest0-21swapper/121:42:041
761599170,2cyclictest0-21swapper/119:58:051
761499171,13cyclictest26963-21python21:46:000
761799161,3cyclictest9562-21fschecks_time22:35:153
761799161,3cyclictest0-21swapper/319:20:133
7617991611,3cyclictest8213-21cut00:15:133
7617991611,3cyclictest0-21swapper/323:55:163
7616991613,2cyclictest8982-21kworker/u8:022:44:012
7616991613,2cyclictest5103-21kworker/u8:023:46:042
7616991613,2cyclictest25154-21kworker/u8:000:00:042
761699160,2cyclictest0-21swapper/222:04:012
7615991613,2cyclictest26303-21kworker/u8:221:26:011
7615991613,2cyclictest2601-21kworker/u8:023:03:041
761599161,2cyclictest0-21swapper/122:15:041
761599161,2cyclictest0-21swapper/100:29:041
761599161,13cyclictest0-21swapper/123:11:021
761599160,2cyclictest0-21swapper/122:33:051
761799151,12cyclictest2091-21ssh23:00:553
761799150,13cyclictest28545-21df22:55:133
761799150,13cyclictest27084-21ssh23:26:473
761699151,3cyclictest4150-21if_eth020:20:152
7616991512,2cyclictest25475-21kworker/u8:222:54:052
7616991512,2cyclictest24168-21kworker/u8:300:36:012
761699151,12cyclictest12331-21sh22:05:052
761699150,13cyclictest7030-21ssh00:14:282
7615991512,2cyclictest7686-21kworker/u8:020:34:051
7615991512,2cyclictest5005-21kworker/u8:200:13:051
761599150,2cyclictest0-21swapper/123:43:041
761599150,2cyclictest0-21swapper/122:47:041
761599150,2cyclictest0-21swapper/121:32:041
761599150,2cyclictest0-21swapper/120:26:041
761599150,2cyclictest0-21swapper/120:01:041
761599150,2cyclictest0-21swapper/119:18:041
761599150,14cyclictest0-21swapper/122:57:051
761599150,14cyclictest0-21swapper/122:53:041
7614991512,2cyclictest23540-21diskmemload23:57:100
761499151,12cyclictest17918-21iostat_ios22:10:160
7614991511,2cyclictest0-21swapper/000:13:500
761499150,3cyclictest0-21swapper/022:25:010
761499150,3cyclictest0-21swapper/022:25:000
761799142,7cyclictest11239-21ssh23:45:003
761799141,11cyclictest12554-21ssh23:11:193
761799140,2cyclictest0-21swapper/322:05:153
761799140,2cyclictest0-21swapper/321:30:163
761799140,13cyclictest23540-21diskmemload00:25:233
761799140,13cyclictest0-21swapper/323:47:233
761799140,13cyclictest0-21swapper/321:40:133
761799140,12cyclictest0-21swapper/321:15:263
761799140,12cyclictest0-21swapper/319:15:133
761699149,3cyclictest12646-21ssh23:11:282
761699142,6cyclictest1494-21ssh23:35:002
7616991411,2cyclictest7926-21kworker/u8:119:35:042
7616991411,2cyclictest26303-21kworker/u8:221:12:042
7616991411,2cyclictest23497-21kworker/u8:223:58:052
7616991411,2cyclictest16735-21kworker/u8:123:22:042
7616991411,2cyclictest14765-21kworker/u8:220:47:042
7616991411,2cyclictest0-21swapper/223:36:182
7616991411,2cyclictest0-21swapper/220:50:282
7616991411,2cyclictest0-21swapper/219:20:282
7616991410,2cyclictest18758-21ssh22:11:012
761699140,2cyclictest0-21swapper/222:27:082
761699140,12cyclictest0-21swapper/222:35:532
7615991411,2cyclictest26303-21kworker/u8:221:14:061
761599140,7cyclictest0-21swapper/120:53:041
761599140,2cyclictest0-21swapper/123:30:041
761599140,2cyclictest0-21swapper/123:15:041
761599140,2cyclictest0-21swapper/122:42:041
761599140,2cyclictest0-21swapper/122:24:041
761599140,2cyclictest0-21swapper/122:24:041
761599140,2cyclictest0-21swapper/122:10:051
761599140,2cyclictest0-21swapper/120:58:041
761599140,2cyclictest0-21swapper/119:30:051
761599140,1cyclictest0-21swapper/119:10:041
761599140,12cyclictest1771-21irqstats21:20:141
7614991411,2cyclictest0-21swapper/021:40:290
7614991411,2cyclictest0-21swapper/021:13:100
761499140,2cyclictest23540-21diskmemload23:27:190
761499140,12cyclictest14630-21ssh23:48:030
761499140,12cyclictest0-21swapper/022:28:320
761499140,12cyclictest0-21swapper/021:51:590
761799138,3cyclictest4269-21ssh23:36:473
7617991310,2cyclictest0-21swapper/322:25:473
7617991310,2cyclictest0-21swapper/322:15:053
7617991310,2cyclictest0-21swapper/322:12:553
7617991310,2cyclictest0-21swapper/322:02:063
7617991310,2cyclictest0-21swapper/321:47:533
7617991310,2cyclictest0-21swapper/321:20:103
7617991310,2cyclictest0-21swapper/320:44:053
7617991310,2cyclictest0-21swapper/320:30:123
7617991310,2cyclictest0-21swapper/300:30:163
7617991310,2cyclictest0-21swapper/300:20:583
7617991310,2cyclictest0-21swapper/300:06:323
761799130,2cyclictest0-21swapper/323:17:273
761799130,2cyclictest0-21swapper/322:30:063
761799130,2cyclictest0-21swapper/300:35:533
761799130,2cyclictest0-21swapper/300:00:413
761799130,12cyclictest23540-21diskmemload22:43:063
761799130,12cyclictest0-21swapper/323:22:043
761799130,12cyclictest0-21swapper/322:49:133
761799130,12cyclictest0-21swapper/322:23:483
761799130,12cyclictest0-21swapper/322:23:473
761799130,12cyclictest0-21swapper/319:45:163
761799130,12cyclictest0-21swapper/300:13:133
761799130,11cyclictest23540-21diskmemload21:55:253
761699131,2cyclictest20444-21ssh00:28:042
7616991310,2cyclictest8982-21kworker/u8:022:45:042
7616991310,2cyclictest7926-21kworker/u8:119:43:042
7616991310,2cyclictest26303-21kworker/u8:221:15:042
7616991310,2cyclictest0-21swapper/222:30:412
7616991310,2cyclictest0-21swapper/222:20:102
7616991310,2cyclictest0-21swapper/222:20:102
7616991310,2cyclictest0-21swapper/221:40:132
7616991310,2cyclictest0-21swapper/200:31:282
761699130,8cyclictest0-21swapper/223:01:042
761699130,2cyclictest8877-21ssh23:08:052
761699130,2cyclictest0-21swapper/223:18:352
761699130,12cyclictest0-21swapper/221:55:112
761699130,12cyclictest0-21swapper/219:55:182
761699130,12cyclictest0-21swapper/200:16:182
761699130,11cyclictest3728-21runrttasks21:21:072
761599132,6cyclictest0-21swapper/100:35:001
761599131,7cyclictest0-21swapper/122:00:001
7615991310,2cyclictest0-21swapper/119:40:171
7615991310,2cyclictest0-21swapper/100:22:341
761599130,2cyclictest0-21swapper/123:05:131
761599130,2cyclictest0-21swapper/119:27:041
761599130,2cyclictest0-21swapper/100:16:051
761599130,11cyclictest0-21swapper/123:55:181
761499138,3cyclictest3002-21ssh23:01:430
761499138,3cyclictest25393-21unixbench_singl19:51:030
761499132,6cyclictest0-21swapper/023:40:000
761499132,6cyclictest0-21swapper/020:35:000
761499131,6cyclictest0-21swapper/000:20:000
7614991310,2cyclictest0-21swapper/023:22:490
7614991310,2cyclictest0-21swapper/023:18:490
7614991310,2cyclictest0-21swapper/023:07:520
7614991310,2cyclictest0-21swapper/022:58:390
7614991310,2cyclictest0-21swapper/022:53:430
7614991310,2cyclictest0-21swapper/022:30:590
7614991310,2cyclictest0-21swapper/022:07:390
7614991310,2cyclictest0-21swapper/020:15:110
7614991310,2cyclictest0-21swapper/000:34:400
761499130,2cyclictest0-21swapper/023:14:490
761499130,2cyclictest0-21swapper/022:44:400
761499130,12cyclictest0-21swapper/000:39:110
761499130,12cyclictest0-21swapper/000:26:100
761499130,11cyclictest0-21swapper/021:55:410
81612120,8sleep20-21swapper/223:40:572
761799129,2cyclictest0-21swapper/323:31:573
761799129,2cyclictest0-21swapper/322:50:133
761799121,6cyclictest0-21swapper/319:40:013
761799120,2cyclictest0-21swapper/319:50:153
761799120,2cyclictest0-21swapper/319:10:093
761799120,11cyclictest29895-21copy21:50:023
761799120,11cyclictest0-21swapper/321:10:353
761699129,2cyclictest7926-21kworker/u8:119:34:042
761699129,2cyclictest27473-21kworker/u8:220:05:042
761699129,2cyclictest22086-21kworker/u8:019:50:042
761699129,2cyclictest10293-21kworker/u8:021:30:042
761699129,2cyclictest0-21swapper/221:52:392
761699129,2cyclictest0-21swapper/200:20:162
761699122,6cyclictest23540-21diskmemload21:36:002
761699120,2cyclictest0-21swapper/223:25:072
761699120,2cyclictest0-21swapper/220:00:202
761699120,11cyclictest0-21swapper/221:00:132
761699120,11cyclictest0-21swapper/200:06:582
761599121,9cyclictest15669-21apt-get21:35:101
761599121,3cyclictest25195-21grep23:25:141
7615991210,1cyclictest0-21swapper/123:45:191
761599120,11cyclictest0-21swapper/122:36:201
761599120,11cyclictest0-21swapper/120:15:111
761599120,11cyclictest0-21swapper/100:00:141
761499129,2cyclictest23540-21diskmemload21:18:420
761499129,2cyclictest0-21swapper/021:36:500
761499129,2cyclictest0-21swapper/021:32:590
761499129,2cyclictest0-21swapper/021:25:090
761499129,2cyclictest0-21swapper/019:20:120
761499128,2cyclictest0-21swapper/022:38:390
761499122,7cyclictest0-21swapper/019:12:580
761499120,3cyclictest16779-21grep20:50:590
761499120,2cyclictest0-21swapper/021:22:420
761499120,2cyclictest0-21swapper/019:55:140
761499120,11cyclictest0-21swapper/023:54:320
761499120,11cyclictest0-21swapper/022:15:010
761499120,11cyclictest0-21swapper/021:01:020
761499120,11cyclictest0-21swapper/020:35:120
761499120,11cyclictest0-21swapper/000:06:420
761799118,2cyclictest0-21swapper/320:10:153
761799111,6cyclictest0-21swapper/320:26:003
761799110,6cyclictest0-21swapper/320:10:013
761799110,2cyclictest0-21swapper/319:25:053
761699118,2cyclictest7926-21kworker/u8:119:26:012
761699112,5cyclictest0-21swapper/220:20:002
761599110,3cyclictest0-21swapper/120:05:161
761499112,6cyclictest0-21swapper/020:43:010
761499112,6cyclictest0-21swapper/020:12:580
761499111,6cyclictest0-21swapper/020:25:100
761499111,6cyclictest0-21swapper/020:01:090
761499110,2cyclictest0-21swapper/023:30:430
761799107,2cyclictest0-21swapper/319:56:033
761799101,5cyclictest0-21swapper/320:15:113
761699107,2cyclictest0-21swapper/221:05:122
761699107,2cyclictest0-21swapper/220:27:052
761699105,3cyclictest10096-21grep19:15:122
761699100,6cyclictest0-21swapper/220:32:052
761499105,3cyclictest3688-21Xorg20:21:580
761499105,3cyclictest18557-21expr20:55:170
761499101,3cyclictest23530-21cron21:10:000
761499101,3cyclictest11623-21cron19:20:000
761499100,7cyclictest0-21swapper/019:33:580
761499100,6cyclictest0-21swapper/019:26:020
76179994,3cyclictest4385-21missed_timers20:20:163
76179994,3cyclictest21363-21unixbench_singl19:41:053
76179994,3cyclictest17151-21uptime20:51:023
76179994,3cyclictest15974-21head19:30:123
76179994,3cyclictest13681-21sshd20:45:043
76179991,3cyclictest18610-21ntp_states20:55:193
76179991,3cyclictest0-21swapper/321:00:133
76169996,2cyclictest0-21swapper/219:10:092
76169994,3cyclictest3728-21runrttasks20:43:352
76169994,3cyclictest32105-21tr20:10:132
76169994,3cyclictest18091-21sed20:55:142
76169992,6cyclictest0-21swapper/220:36:012
76149994,3cyclictest29976-21aten2.4_r3power20:05:120
76149991,3cyclictest13786-21head20:45:120
76179983,3cyclictest28082-21aten2.4_r3power20:00:133
76179983,3cyclictest21847-21basename21:05:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional