You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 09:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Mon Mar 16, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
204922122111,6sleep30-21swapper/319:08:183
20534211493,16sleep00-21swapper/019:08:510
204592113102,6sleep20-21swapper/219:07:532
20361211193,13sleep10-21swapper/119:06:361
96342740,0sleep30-21swapper/321:15:093
50612490,1sleep35060-21ssh21:43:073
115452490,1sleep00-21swapper/000:02:170
20653993015,13cyclictest0-21swapper/223:05:132
182102230,0sleep20-21swapper/222:30:122
20654992218,2cyclictest0-21swapper/322:50:123
2065399221,3cyclictest21249-21ssh22:00:122
2065399221,19cyclictest0-21swapper/220:05:112
2065499210,19cyclictest0-21swapper/320:00:133
20652992116,3cyclictest13651-21ssh00:05:111
2065299210,19cyclictest0-21swapper/120:00:131
2065199211,2cyclictest5744-21ssh00:30:110
2065399191,2cyclictest0-21swapper/221:05:102
314342180,1sleep131438-21fschecks_time20:55:121
304582180,0sleep10-21swapper/100:21:221
261722170,1sleep00-21swapper/000:17:160
20653991712,3cyclictest0-21swapper/200:15:062
20651991714,2cyclictest27992-21kworker/u8:023:26:000
20654991612,2cyclictest29155-21ssh21:35:113
20654991611,3cyclictest0-21swapper/323:40:133
2065499160,14cyclictest0-21swapper/322:08:563
2065399163,2cyclictest0-21swapper/222:24:062
2065399163,11cyclictest301ktimersoftd/200:26:302
2065399160,14cyclictest0-21swapper/200:04:162
2065299160,14cyclictest26558-21ssh21:31:311
2065199161,13cyclictest9713-21ssh21:47:450
2065499151,3cyclictest3621-21ssh23:20:503
20654991512,2cyclictest27992-21kworker/u8:022:59:043
20654991512,2cyclictest12142-21kworker/u8:123:33:043
2065499150,3cyclictest0-21swapper/323:10:183
2065399152,7cyclictest0-21swapper/223:50:002
20653991512,2cyclictest301ktimersoftd/223:25:192
2065399151,12cyclictest4458-21diskmemload00:10:102
2065399150,13cyclictest13539-21ssh22:58:102
20652991511,2cyclictest207150irq/24-eth123:32:061
20652991510,3cyclictest2248-21telnet23:20:121
2065299150,13cyclictest0-21swapper/123:05:001
20651991512,2cyclictest18409-21kworker/u8:100:13:040
20651991512,2cyclictest0-21swapper/000:38:360
2065199151,12cyclictest25569-21sh19:20:140
2065199151,12cyclictest0-21swapper/022:48:530
67062141,3sleep36944-21df21:45:133
55182140,3sleep10-21swapper/121:43:501
2065499149,3cyclictest20935-21ssh22:32:153
2065499149,3cyclictest15379-21cpuspeed_turbos23:00:123
2065499142,6cyclictest0-21swapper/320:55:003
2065499142,6cyclictest0-21swapper/319:15:003
20654991411,2cyclictest8533-21kworker/u8:222:48:043
20654991411,2cyclictest0-21swapper/323:15:133
20654991410,2cyclictest20502-21ssh00:11:053
2065499140,12cyclictest13636-21munin-node3
2065499140,12cyclictest0-21swapper/321:12:033
2065499140,12cyclictest0-21swapper/300:37:213
2065499140,12cyclictest0-21swapper/300:20:143
2065399144,7cyclictest4562-21gdm-simple-gree21:37:592
2065399142,7cyclictest28758-21copy20:50:002
2065399142,7cyclictest0-21swapper/200:00:002
2065399142,6cyclictest0-21swapper/219:50:002
2065399142,6cyclictest0-21swapper/219:10:002
20653991411,2cyclictest4458-21diskmemload23:18:152
20653991411,2cyclictest301ktimersoftd/223:35:442
2065399141,12cyclictest301ktimersoftd/200:23:102
20653991411,2cyclictest0-21swapper/222:36:452
2065399141,12cyclictest0-21swapper/200:31:162
20653991410,2cyclictest0-21swapper/222:25:062
2065399140,2cyclictest0-21swapper/222:50:132
2065399140,2cyclictest0-21swapper/220:35:002
2065399140,13cyclictest0-21swapper/223:40:152
2065399140,13cyclictest0-21swapper/219:25:142
2065399140,12cyclictest4458-21diskmemload21:16:052
2065399140,12cyclictest28478-21ssh21:34:282
2065399140,12cyclictest0-21swapper/223:00:132
2065399140,12cyclictest0-21swapper/221:48:592
2065399140,12cyclictest0-21swapper/200:07:082
2065299143,9cyclictest13428-21grep21:51:031
2065299142,6cyclictest3728-21runrttasks22:50:011
20652991411,2cyclictest0-21swapper/120:06:011
20652991410,3cyclictest0-21swapper/100:10:121
2065299140,2cyclictest0-21swapper/122:34:081
2065299140,2cyclictest0-21swapper/100:16:411
2065299140,12cyclictest0-21swapper/122:45:131
2065299140,12cyclictest0-21swapper/100:36:161
20651991411,2cyclictest8533-21kworker/u8:222:24:040
20651991411,2cyclictest616-21kworker/u8:120:01:040
20651991411,2cyclictest12821-21kworker/u8:021:52:040
20651991411,2cyclictest11671-21kworker/u8:121:24:040
20651991411,2cyclictest11671-21kworker/u8:121:18:010
2065199140,12cyclictest26463-21python23:11:010
2065199140,12cyclictest0-21swapper/023:01:050
58992130,1sleep00-21swapper/022:16:390
2065499132,6cyclictest0-21swapper/322:15:013
2065499132,6cyclictest0-21swapper/320:25:003
20654991310,2cyclictest23866-21ssh21:29:513
20654991310,2cyclictest23279-21ssh00:15:023
20654991310,2cyclictest0-21swapper/323:51:263
20654991310,2cyclictest0-21swapper/323:39:563
20654991310,2cyclictest0-21swapper/322:15:393
20654991310,2cyclictest0-21swapper/319:35:133
2065499130,2cyclictest9482-21if_eth000:00:173
2065499130,2cyclictest0-21swapper/323:48:223
2065499130,2cyclictest0-21swapper/323:05:163
2065499130,2cyclictest0-21swapper/322:40:143
2065499130,2cyclictest0-21swapper/322:27:223
2065499130,2cyclictest0-21swapper/322:20:443
2065499130,2cyclictest0-21swapper/320:41:013
2065499130,12cyclictest0-21swapper/323:58:443
2065499130,12cyclictest0-21swapper/323:26:023
2065499130,12cyclictest0-21swapper/321:30:173
2065499130,12cyclictest0-21swapper/321:05:153
2065499130,12cyclictest0-21swapper/300:26:153
2065499130,11cyclictest0-21swapper/321:20:023
2065399132,6cyclictest0-21swapper/222:00:002
2065399132,10cyclictest301ktimersoftd/221:28:322
2065399131,7cyclictest0-21swapper/221:00:002
2065399131,2cyclictest301ktimersoftd/200:37:132
2065399131,2cyclictest29562-21ssh22:08:232
2065399131,11cyclictest301ktimersoftd/223:53:072
2065399131,11cyclictest301ktimersoftd/222:13:172
2065399131,11cyclictest301ktimersoftd/221:21:082
20653991310,2cyclictest0-21swapper/223:30:152
20653991310,2cyclictest0-21swapper/222:40:132
20653991310,2cyclictest0-21swapper/222:17:452
20653991310,2cyclictest0-21swapper/219:36:032
2065399130,2cyclictest7791-21ssh21:12:382
2065399130,2cyclictest0-21swapper/221:40:172
2065399130,12cyclictest301ktimersoftd/219:50:142
2065399130,12cyclictest0-21swapper/223:20:002
2065399130,12cyclictest0-21swapper/220:40:122
2065399130,12cyclictest0-21swapper/220:25:142
2065399130,12cyclictest0-21swapper/219:55:152
20652991310,2cyclictest0-21swapper/123:10:131
20652991310,2cyclictest0-21swapper/122:58:121
20652991310,2cyclictest0-21swapper/122:11:271
20652991310,2cyclictest0-21swapper/121:55:141
20652991310,2cyclictest0-21swapper/121:46:021
20652991310,2cyclictest0-21swapper/121:29:411
20652991310,2cyclictest0-21swapper/121:20:201
20652991310,2cyclictest0-21swapper/121:00:001
20652991310,2cyclictest0-21swapper/120:40:001
20652991310,2cyclictest0-21swapper/100:27:121
2065299130,2cyclictest0-21swapper/123:45:311
2065299130,2cyclictest0-21swapper/122:40:171
2065299130,2cyclictest0-21swapper/120:26:031
2065299130,2cyclictest0-21swapper/119:10:151
2065299130,12cyclictest0-21swapper/122:37:211
2065299130,12cyclictest0-21swapper/122:05:151
2065299130,11cyclictest0-21swapper/123:05:081
2065299130,11cyclictest0-21swapper/100:01:261
2065199139,2cyclictest0-21swapper/019:16:010
2065199133,6cyclictest0-21swapper/019:50:280
20651991310,2cyclictest14844-21ssh00:05:300
20651991310,2cyclictest0-21swapper/022:30:180
20651991310,2cyclictest0-21swapper/022:10:130
20651991310,2cyclictest0-21swapper/022:02:360
20651991310,2cyclictest0-21swapper/021:33:060
20651991310,2cyclictest0-21swapper/019:30:190
2065199130,2cyclictest0-21swapper/023:44:060
2065199130,2cyclictest0-21swapper/023:16:030
2065199130,2cyclictest0-21swapper/022:40:180
2065199130,2cyclictest0-21swapper/022:25:180
2065199130,12cyclictest0-21swapper/021:37:560
2065199130,11cyclictest0-21swapper/022:37:190
2065199130,11cyclictest0-21swapper/000:25:160
2065199130,11cyclictest0-21swapper/000:21:460
8642120,2sleep30-21swapper/321:00:123
2065499129,2cyclictest0-21swapper/321:50:143
2065499129,2cyclictest0-21swapper/319:25:403
2065499121,6cyclictest0-21swapper/320:20:003
2065499120,2cyclictest0-21swapper/322:35:043
2065499120,2cyclictest0-21swapper/320:25:123
2065499120,11cyclictest0-21swapper/322:00:133
2065499120,11cyclictest0-21swapper/321:56:253
2065399129,2cyclictest0-21swapper/222:47:082
2065399129,2cyclictest0-21swapper/221:51:152
2065399129,2cyclictest0-21swapper/221:00:092
2065399129,2cyclictest0-21swapper/219:30:182
2065399122,7cyclictest0-21swapper/219:19:592
2065399121,8cyclictest0-21swapper/220:36:592
2065399120,2cyclictest0-21swapper/220:20:302
2065399120,1cyclictest0-21swapper/223:10:102
2065299129,2cyclictest0-21swapper/123:55:071
2065299129,2cyclictest0-21swapper/121:35:381
2065299129,2cyclictest0-21swapper/120:10:171
2065299129,2cyclictest0-21swapper/119:50:191
2065299129,2cyclictest0-21swapper/119:45:181
2065299127,3cyclictest17312-21perl23:35:161
2065299127,3cyclictest0-21swapper/119:35:161
2065299121,9cyclictest0-21swapper/120:15:151
2065299121,9cyclictest0-21swapper/120:00:001
2065299121,9cyclictest0-21swapper/119:40:141
2065299121,9cyclictest0-21swapper/119:20:131
2065299121,5cyclictest0-21swapper/121:05:001
2065299121,3cyclictest7181-21ssh23:25:111
2065299121,3cyclictest0-21swapper/122:29:161
2065299121,3cyclictest0-21swapper/122:15:131
2065299121,2cyclictest4458-21diskmemload23:15:261
2065299120,2cyclictest0-21swapper/121:15:321
2065299120,2cyclictest0-21swapper/121:13:081
2065299120,2cyclictest0-21swapper/120:45:301
2065299120,2cyclictest0-21swapper/119:15:291
2065299120,11cyclictest0-21swapper/123:52:091
2065299120,11cyclictest0-21swapper/123:40:101
2065299120,11cyclictest0-21swapper/122:20:021
2065299120,11cyclictest0-21swapper/122:01:101
2065299120,11cyclictest0-21swapper/120:35:161
2065299120,11cyclictest0-21swapper/119:30:121
2065299120,11cyclictest0-21swapper/119:25:191
2065299120,11cyclictest0-21swapper/100:33:431
2065199129,2cyclictest27992-21kworker/u8:023:36:050
2065199129,2cyclictest26528-21kworker/u8:023:52:030
2065199129,2cyclictest0-21swapper/022:58:070
2065199129,2cyclictest0-21swapper/021:30:000
2065199129,2cyclictest0-21swapper/020:50:060
2065199129,2cyclictest0-21swapper/020:05:160
2065199122,7cyclictest1820-21copy23:20:020
2065199121,5cyclictest31058-21ssh23:50:000
2065199120,2cyclictest0-21swapper/020:40:140
2065199120,2cyclictest0-21swapper/020:25:130
2065199120,11cyclictest6581-21ssh23:57:090
2065199120,11cyclictest15989-21ssh23:34:250
2065199120,11cyclictest0-21swapper/023:05:040
2065199120,11cyclictest0-21swapper/022:07:160
2065199120,11cyclictest0-21swapper/020:10:190
2065199120,10cyclictest0-21swapper/022:51:400
2065199120,10cyclictest0-21swapper/021:40:090
2065499119,1cyclictest26692-21copy20:45:013
2065499118,2cyclictest0-21swapper/319:20:143
2065499112,6cyclictest0-21swapper/319:56:593
2065499112,6cyclictest0-21swapper/319:41:003
2065499111,6cyclictest0-21swapper/320:40:003
2065499110,1cyclictest0-21swapper/300:30:543
2065399111,6cyclictest0-21swapper/220:16:012
2065299110,9cyclictest16799-21apt-get20:20:121
2065199118,2cyclictest616-21kworker/u8:120:20:040
2065199118,2cyclictest4885-21kworker/u8:221:12:040
2065199118,2cyclictest22346-21kworker/u8:019:46:050
2065199112,6cyclictest0-21swapper/020:58:020
112222110,1sleep30-21swapper/320:05:143
2065499105,3cyclictest29702-21grep19:30:173
2065499105,3cyclictest13548-21missed_timers20:10:183
2065499102,5cyclictest0-21swapper/320:56:593
2065399100,7cyclictest0-21swapper/220:10:022
2065399100,6cyclictest0-21swapper/220:51:012
2065299107,2cyclictest0-21swapper/120:50:191
2065299105,3cyclictest22615-21turbostat.cron20:35:001
2065199107,2cyclictest616-21kworker/u8:120:19:040
2065199107,2cyclictest30942-21kworker/u8:021:07:040
2065199102,6cyclictest0-21swapper/021:02:590
2065199101,6cyclictest0-21swapper/020:49:590
2065199100,2cyclictest0-21swapper/019:36:010
206549994,3cyclictest2519-21aten2.4_r3power19:45:113
206549994,3cyclictest20848-21cut20:30:123
206549994,3cyclictest0-21swapper/319:50:153
206549993,4cyclictest23351-21cut19:15:143
206539994,3cyclictest25766-21tr19:20:162
206539991,3cyclictest0-21swapper/220:00:122
206519996,2cyclictest22346-21kworker/u8:019:40:030
206519996,2cyclictest19886-21kworker/u8:220:36:010
206519994,3cyclictest16385-21telnet21:55:130
206519991,4cyclictest0-21swapper/020:29:590
206519990,6cyclictest0-21swapper/019:10:130
206539983,3cyclictest510-21hostname19:40:112
206519984,3cyclictest6801-21aten2.4_r3power19:55:120
206519983,3cyclictest26955-21hostname19:25:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional