You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-19 - 13:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Fri Jun 19, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
265672121110,6sleep20-21swapper/219:06:252
268162119108,6sleep10-21swapper/119:09:381
267032115104,6sleep30-21swapper/319:08:113
26815210493,6sleep00-21swapper/019:09:370
51522800,0sleep30-21swapper/322:13:543
34822710,0sleep30-21swapper/323:22:013
295702700,1sleep20-21swapper/222:05:122
295702700,1sleep20-21swapper/222:05:122
30522690,0sleep00-21swapper/000:31:360
249782690,0sleep10-21swapper/120:25:001
2687399290,28cyclictest0-21swapper/020:55:130
18982280,0sleep20-21swapper/223:55:282
2687599270,22cyclictest0-21swapper/200:15:122
55822250,0sleep00-21swapper/021:39:120
84142220,1sleep3381ktimersoftd/323:27:263
26875992218,2cyclictest0-21swapper/223:20:122
2687599210,3cyclictest13337-21taskset00:08:102
2687599210,3cyclictest11014-21munin-node2
2687599210,3cyclictest0-21swapper/223:32:592
2687599210,3cyclictest0-21swapper/223:10:142
2687599210,3cyclictest0-21swapper/222:50:582
2687599210,3cyclictest0-21swapper/222:35:142
2687399210,2cyclictest0-21swapper/022:30:120
2687599200,3cyclictest8422-21ssh00:02:422
2687599200,3cyclictest3169-21ssh21:35:582
2687599200,3cyclictest29201-21ssh23:50:142
2687599200,3cyclictest15361-21fschecks_time23:35:142
2687599200,3cyclictest12800-21ssh22:56:502
2687599200,3cyclictest0-21swapper/223:17:062
2687599200,3cyclictest0-21swapper/222:48:062
2687599200,3cyclictest0-21swapper/222:30:142
2687599200,3cyclictest0-21swapper/222:20:062
2687599200,3cyclictest0-21swapper/222:15:032
2687599200,3cyclictest0-21swapper/221:58:072
2687599200,3cyclictest0-21swapper/221:31:072
2687599200,3cyclictest0-21swapper/221:20:422
2687599200,3cyclictest0-21swapper/220:20:142
2687599200,3cyclictest0-21swapper/200:20:192
2687599200,2cyclictest18179-21ssh00:13:372
2687599200,2cyclictest0-21swapper/220:05:192
2687399200,18cyclictest0-21swapper/020:40:090
220862200,1sleep12687499cyclictest00:17:261
2687599190,3cyclictest10657-21diskmemload22:41:192
2687599190,3cyclictest0-21swapper/222:00:342
2687599190,3cyclictest0-21swapper/221:40:302
2687599190,2cyclictest5717-21ssh23:25:102
2687599190,2cyclictest2700-21cut19:30:102
2687599190,2cyclictest17680-21ssh23:02:142
2687599190,2cyclictest0-21swapper/221:15:102
2687599190,2cyclictest0-21swapper/221:00:132
2687599190,2cyclictest0-21swapper/219:20:102
2687599190,2cyclictest0-21swapper/200:35:142
26873991916,2cyclictest8157-21kworker/u8:122:43:040
173792190,0sleep30-21swapper/321:51:143
26875991810,7cyclictest0-21swapper/222:25:152
2687599180,3cyclictest29842-21ssh00:25:342
2687599180,3cyclictest0-21swapper/222:12:542
2687599180,3cyclictest0-21swapper/221:29:182
2687599180,3cyclictest0-21swapper/221:14:142
2687599180,2cyclictest31042sleep200:31:422
2687599180,2cyclictest0-21swapper/223:45:272
2687599180,2cyclictest0-21swapper/223:05:312
2687599180,2cyclictest0-21swapper/221:52:582
2687599180,2cyclictest0-21swapper/220:55:182
2687599180,2cyclictest0-21swapper/220:29:182
2687599180,2cyclictest0-21swapper/219:25:142
2687599180,2cyclictest0-21swapper/219:15:112
2687399182,2cyclictest0-21swapper/023:48:050
26873991815,2cyclictest6606-21kworker/u8:121:41:040
159142180,0sleep30-21swapper/323:35:193
26876991714,2cyclictest19580-21kworker/u8:123:17:043
26876991714,2cyclictest12851-21kworker/u8:000:00:053
2687599179,7cyclictest0-21swapper/219:40:152
2687599170,2cyclictest0-21swapper/223:41:542
2687499170,2cyclictest0-21swapper/123:48:041
2687499170,2cyclictest0-21swapper/100:10:201
26873991714,2cyclictest26315-21kworker/u8:021:34:040
2687399171,2cyclictest10000-21apt-get22:20:050
26876991613,2cyclictest26315-21kworker/u8:021:37:043
26876991613,2cyclictest26315-21kworker/u8:021:30:053
2687699160,2cyclictest0-21swapper/323:48:043
2687599160,2cyclictest0-21swapper/219:37:062
2687499161,3cyclictest28887-21date20:35:011
26874991613,2cyclictest207150irq/24-eth122:13:041
26874991613,2cyclictest14162-21kworker/u8:223:00:041
2687499161,13cyclictest29556-21aten2.4_r3power21:30:121
2687499160,14cyclictest0-21swapper/100:02:271
26873991613,2cyclictest25426-21kworker/u8:223:51:040
26873991613,2cyclictest23188-21kworker/u8:220:46:040
26873991613,2cyclictest19580-21kworker/u8:123:06:040
26876991512,2cyclictest0-21swapper/321:11:593
2687599155,8cyclictest28429-21grep20:31:022
2687599154,9cyclictest3728-21runrttasks19:11:282
2687599154,9cyclictest11006-21telnet19:50:102
2687599153,9cyclictest9121-21tr19:45:112
2687599153,3cyclictest3277-21wget20:50:162
2687599153,10cyclictest31139-21basename20:40:112
2687599153,10cyclictest29620-21fschecks_time20:35:142
2687599150,2cyclictest0-21swapper/220:03:102
2687499151,3cyclictest21479-21fschecks_time20:15:131
2687499151,3cyclictest0-21swapper/100:06:551
2687499151,12cyclictest0-21swapper/121:58:211
2687499150,3cyclictest30468-21sh22:05:301
2687499150,3cyclictest30468-21sh22:05:291
2687499150,2cyclictest0-21swapper/123:23:191
2687499150,14cyclictest0-21swapper/122:54:591
2687499150,13cyclictest10612-21munin-node1
2687499150,13cyclictest0-21swapper/123:17:041
26873991512,2cyclictest22989-21kworker/u8:222:35:540
26873991512,2cyclictest13361-21kworker/u8:221:18:040
26873991512,2cyclictest10367-21kworker/u8:021:13:040
2687399151,12cyclictest17657-21iostat_ios20:05:160
26876991411,2cyclictest6002-21kworker/u8:023:02:053
26876991411,2cyclictest3762-21kworker/u8:219:59:043
26876991411,2cyclictest28627-21kworker/u8:222:05:043
26876991411,2cyclictest28627-21kworker/u8:222:05:043
26876991411,2cyclictest27406-21ssh21:27:093
26876991411,2cyclictest0-21swapper/323:06:103
26876991411,2cyclictest0-21swapper/300:37:133
2687699140,2cyclictest10282-21ssh22:20:053
2687699140,2cyclictest0-21swapper/322:38:323
2687699140,13cyclictest0-21swapper/323:30:203
2687699140,13cyclictest0-21swapper/322:52:203
2687699140,13cyclictest0-21swapper/320:55:293
2687699140,12cyclictest0-21swapper/322:26:033
2687699140,12cyclictest0-21swapper/321:18:423
2687599144,8cyclictest88542sleep221:05:042
2687599143,9cyclictest21036-21stty20:15:102
2687599143,9cyclictest1082-21expr20:45:142
2687599141,3cyclictest0-21swapper/220:10:132
2687599141,3cyclictest0-21swapper/219:55:072
26874991411,2cyclictest0-21swapper/123:53:371
2687499140,2cyclictest10657-21diskmemload23:26:091
2687499140,13cyclictest0-21swapper/123:09:291
2687499140,13cyclictest0-21swapper/122:16:291
2687499140,13cyclictest0-21swapper/121:51:491
2687499140,13cyclictest0-21swapper/121:46:301
2687499140,13cyclictest0-21swapper/119:50:591
2687499140,13cyclictest0-21swapper/119:45:591
2687499140,12cyclictest0-21swapper/121:40:241
2687499140,12cyclictest0-21swapper/120:55:411
2687499140,12cyclictest0-21swapper/100:25:311
2687399141,2cyclictest24325-21telnet23:10:120
26873991411,2cyclictest8845-21ssh00:03:240
26873991411,2cyclictest8338-21kworker/u8:019:37:040
26873991411,2cyclictest6606-21kworker/u8:122:00:040
26873991411,2cyclictest420-21kworker/u8:222:49:040
26873991411,2cyclictest3762-21kworker/u8:219:33:050
26873991411,2cyclictest14162-21kworker/u8:223:01:040
26873991411,2cyclictest13361-21kworker/u8:221:22:020
26873991411,2cyclictest10385-21kworker/u8:119:51:040
26873991411,2cyclictest0-21swapper/023:26:040
26873991411,2cyclictest0-21swapper/019:15:130
26873991411,2cyclictest0-21swapper/000:20:140
2687399140,2cyclictest0-21swapper/021:01:030
2687399140,2cyclictest0-21swapper/019:25:130
2687399140,2cyclictest0-21swapper/000:29:340
2687399140,13cyclictest0-21swapper/000:37:050
2687399140,12cyclictest16781-21ssh00:11:180
2687399140,12cyclictest12952-21ssh22:57:080
26876991310,2cyclictest8338-21kworker/u8:019:16:053
26876991310,2cyclictest3760-21kworker/u8:022:15:053
26876991310,2cyclictest26315-21kworker/u8:021:49:043
26876991310,2cyclictest20063-21kworker/u8:120:14:043
26876991310,2cyclictest12851-21kworker/u8:023:50:043
26876991310,2cyclictest0-21swapper/322:45:133
26876991310,2cyclictest0-21swapper/322:02:133
26876991310,2cyclictest0-21swapper/321:43:113
26876991310,2cyclictest0-21swapper/320:45:173
26876991310,2cyclictest0-21swapper/319:26:523
26876991310,2cyclictest0-21swapper/300:30:023
26876991310,2cyclictest0-21swapper/300:26:323
26876991310,2cyclictest0-21swapper/300:15:133
26876991310,2cyclictest0-21swapper/300:12:433
2687699130,12cyclictest19579-21ssh22:30:103
2687699130,12cyclictest0-21swapper/323:41:523
2687699130,12cyclictest0-21swapper/300:20:193
2687499131,3cyclictest10657-21diskmemload22:30:181
2687499131,10cyclictest31610-21perl20:40:121
2687499131,10cyclictest25048-21sed22:35:181
26874991310,2cyclictest6002-21kworker/u8:022:55:041
26874991310,2cyclictest10657-21diskmemload21:20:201
26874991310,2cyclictest0-21swapper/123:40:011
26874991310,2cyclictest0-21swapper/123:10:321
26874991310,2cyclictest0-21swapper/122:40:511
26874991310,2cyclictest0-21swapper/122:25:011
26874991310,2cyclictest0-21swapper/122:02:211
26874991310,2cyclictest0-21swapper/121:12:381
26874991310,2cyclictest0-21swapper/121:05:191
26874991310,2cyclictest0-21swapper/120:10:101
26874991310,2cyclictest0-21swapper/119:40:011
26874991310,2cyclictest0-21swapper/119:10:181
26874991310,2cyclictest0-21swapper/100:31:451
26874991310,2cyclictest0-21swapper/100:20:091
2687499130,2cyclictest0-21swapper/122:47:051
2687499130,2cyclictest0-21swapper/122:20:051
2687499130,2cyclictest0-21swapper/121:35:311
2687499130,2cyclictest0-21swapper/121:15:091
2687499130,2cyclictest0-21swapper/120:50:191
2687499130,2cyclictest0-21swapper/120:45:161
2687499130,2cyclictest0-21swapper/119:55:481
2687499130,2cyclictest0-21swapper/100:36:291
2687499130,12cyclictest0-21swapper/123:58:331
2687499130,12cyclictest0-21swapper/123:35:251
2687499130,12cyclictest0-21swapper/121:25:561
2687499130,12cyclictest0-21swapper/120:05:191
2687499130,12cyclictest0-21swapper/119:35:131
2687499130,11cyclictest0-21swapper/119:15:391
26873991310,2cyclictest31516-21kworker/u8:322:17:040
26873991310,2cyclictest31516-21kworker/u8:322:10:040
26873991310,2cyclictest29223-21kworker/u8:120:52:040
26873991310,2cyclictest18665-21kworker/u8:221:54:040
26873991310,2cyclictest0-21swapper/023:34:380
26873991310,2cyclictest0-21swapper/020:25:170
26873991310,2cyclictest0-21swapper/000:19:070
2687399130,2cyclictest0-21swapper/023:55:440
2687399130,2cyclictest0-21swapper/023:17:540
2687399130,2cyclictest0-21swapper/022:54:160
2687399130,2cyclictest0-21swapper/021:26:040
2687399130,12cyclictest0-21swapper/023:36:340
2687399130,12cyclictest0-21swapper/022:26:580
2687399130,12cyclictest0-21swapper/021:58:230
2687699129,2cyclictest10367-21kworker/u8:021:08:053
2687699129,2cyclictest0-21swapper/300:07:333
2687699120,2cyclictest0-21swapper/321:20:003
2687699120,1cyclictest0-21swapper/319:50:113
2687699120,1cyclictest0-21swapper/319:21:003
2687699120,11cyclictest0-21swapper/323:55:523
2687499121,9cyclictest0-21swapper/121:00:191
2687499121,9cyclictest0-21swapper/120:35:171
2687499121,9cyclictest0-21swapper/120:25:111
2687499121,9cyclictest0-21swapper/120:00:581
2687499121,9cyclictest0-21swapper/119:21:011
2687499120,2cyclictest0-21swapper/119:31:051
2687399129,2cyclictest8338-21kworker/u8:019:13:040
2687399129,2cyclictest6987-21kworker/u8:221:06:010
2687399129,2cyclictest3762-21kworker/u8:219:44:040
2687399129,2cyclictest29223-21kworker/u8:120:39:040
2687399129,2cyclictest0-21swapper/020:30:110
2687399129,2cyclictest0-21swapper/000:05:190
2687399128,2cyclictest0-21swapper/020:15:110
2687399128,2cyclictest0-21swapper/019:55:060
2687399122,6cyclictest0-21swapper/020:20:120
2687399120,2cyclictest0-21swapper/021:46:250
2687399120,11cyclictest0-21swapper/023:43:080
2687399120,11cyclictest0-21swapper/023:20:370
2687399120,11cyclictest0-21swapper/020:00:580
2687399120,11cyclictest0-21swapper/019:45:590
201942120,2sleep00-21swapper/020:11:020
2687699118,2cyclictest6002-21kworker/u8:023:12:043
2687699118,2cyclictest29223-21kworker/u8:120:36:053
2687699118,2cyclictest18665-21kworker/u8:221:58:053
2687699118,2cyclictest14535-21kworker/u8:020:01:043
2687699118,2cyclictest0-21swapper/322:55:553
2687699110,10cyclictest0-21swapper/322:42:563
2687399118,2cyclictest31516-21kworker/u8:322:08:020
2687399118,2cyclictest31516-21kworker/u8:322:08:010
2687699107,2cyclictest8338-21kworker/u8:019:30:043
2687699107,2cyclictest23188-21kworker/u8:220:30:043
2687699107,2cyclictest0-21swapper/320:27:193
2687699106,2cyclictest8267-21grep19:41:023
2687699106,2cyclictest3293-21grep20:50:163
2687699100,8cyclictest0-21swapper/319:48:013
2687499107,2cyclictest8338-21kworker/u8:019:25:041
268769996,2cyclictest23188-21kworker/u8:220:21:043
268769996,2cyclictest0-21swapper/320:15:173
268769996,2cyclictest0-21swapper/319:36:003
268769994,3cyclictest3150-21nscd20:05:143
268769994,3cyclictest31433-21df_abs20:40:123
268769994,3cyclictest27488-21forks19:10:133
268739996,2cyclictest454-21munin-plugin-st19:25:000
268769985,2cyclictest6858-21apt-get21:00:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional