You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-19 - 07:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Fri Dec 19, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27565212094,21sleep00-21swapper/019:08:150
27661211798,14sleep30-21swapper/319:09:303
27436211695,16sleep20-21swapper/219:06:372
274202116105,6sleep10-21swapper/119:06:241
184522820,0sleep00-21swapper/021:17:190
86402710,1sleep30-21swapper/300:23:093
107082680,0sleep10-21swapper/122:26:141
316392270,0sleep00-21swapper/022:13:110
2772899268,16cyclictest0-21swapper/221:40:132
110572250,0sleep20-21swapper/221:05:272
2772999230,14cyclictest0-21swapper/300:25:133
2772999220,13cyclictest0-21swapper/323:21:063
2772899221,19cyclictest0-21swapper/220:10:122
2772999210,3cyclictest0-21swapper/322:55:253
2772999210,13cyclictest11592-21diskmemload22:52:043
2772999210,12cyclictest14479-21ssh21:12:333
2772999210,12cyclictest0-21swapper/321:38:083
278902200,0sleep00-21swapper/021:29:500
2772999200,4cyclictest0-21swapper/300:08:333
2772999200,3cyclictest27845-21ssh22:47:533
2772999200,3cyclictest17000-21cut22:35:133
2772999200,3cyclictest0-21swapper/300:15:133
2772999200,2cyclictest14988-21smartctl19:55:253
2772999200,2cyclictest0-21swapper/323:44:453
2772899200,18cyclictest0-21swapper/219:40:112
2772699200,2cyclictest0-21swapper/022:15:110
223242200,1sleep20-21swapper/220:15:152
2772999190,3cyclictest19350-21ssh23:16:253
2772999190,3cyclictest10109-21df19:45:133
2772999190,3cyclictest0-21swapper/300:33:133
2772999190,2cyclictest4671-21aten2.4_r3power22:20:133
2772999190,2cyclictest28889-21aten2.4-expect22:10:133
2772999190,2cyclictest26224-21uname23:25:173
2772999190,2cyclictest23302-21users00:00:293
2772999190,2cyclictest20521-21ssh22:00:053
2772999190,2cyclictest11592-21diskmemload21:41:363
2772999190,2cyclictest0-21swapper/323:53:013
2772999190,2cyclictest0-21swapper/323:38:053
2772999190,2cyclictest0-21swapper/323:12:253
2772999190,2cyclictest0-21swapper/323:01:133
2772999190,2cyclictest0-21swapper/322:42:333
2772999190,2cyclictest0-21swapper/322:27:433
2772999190,2cyclictest0-21swapper/322:06:333
2772999190,2cyclictest0-21swapper/322:06:333
2772999190,2cyclictest0-21swapper/321:28:273
2772999190,2cyclictest0-21swapper/321:20:053
2772999190,2cyclictest0-21swapper/321:15:133
2772999190,2cyclictest0-21swapper/319:20:133
2772999190,2cyclictest0-21swapper/300:12:283
2772899190,2cyclictest0-21swapper/222:15:112
2772799190,3cyclictest0-21swapper/121:45:151
27726991914,3cyclictest17345-21rm23:15:120
27729991811,6cyclictest0-21swapper/300:35:133
2772999180,3cyclictest31948-21ssh23:32:093
2772999180,2cyclictest8216-21ssh21:45:043
2772999180,2cyclictest8056-21cut21:00:133
2772999180,2cyclictest0-21swapper/323:55:293
2772999180,2cyclictest0-21swapper/323:55:293
2772999180,2cyclictest0-21swapper/323:46:133
2772999180,2cyclictest0-21swapper/323:05:573
2772999180,2cyclictest0-21swapper/322:30:013
2772999180,2cyclictest0-21swapper/322:15:053
2772999180,2cyclictest0-21swapper/321:56:053
2772999180,2cyclictest0-21swapper/321:50:333
2772999180,2cyclictest0-21swapper/321:30:133
2772999180,2cyclictest0-21swapper/320:50:213
2772999180,2cyclictest0-21swapper/320:35:253
2772999170,3cyclictest5335-21apt-get19:35:053
2772999170,2cyclictest0-21swapper/320:10:173
2772999170,2cyclictest0-21swapper/320:00:143
2772999170,2cyclictest0-21swapper/319:50:253
2772999170,15cyclictest0-21swapper/320:15:173
27728991714,2cyclictest6179-21kworker/u8:121:04:042
27728991714,2cyclictest3042-21kworker/u8:220:47:052
27728991714,2cyclictest22926-21kworker/u8:021:33:052
27728991714,2cyclictest19908-21kworker/u8:019:29:052
27728991714,2cyclictest19908-21kworker/u8:019:29:042
27728991714,2cyclictest1650-21kworker/u8:100:33:052
27728991714,2cyclictest1617-21kworker/u8:121:36:042
2772899170,2cyclictest0-21swapper/200:20:122
2772899170,12cyclictest0-21swapper/200:17:042
209912170,2sleep011-21rcuc/023:59:050
209912170,2sleep011-21rcuc/023:59:050
27729991610,5cyclictest0-21swapper/319:10:123
2772999160,2cyclictest8152-21df_abs19:40:133
2772999160,2cyclictest0-21swapper/321:05:173
2772999160,2cyclictest0-21swapper/320:57:333
2772999160,2cyclictest0-21swapper/320:45:293
2772999160,2cyclictest0-21swapper/320:22:373
27728991613,2cyclictest4135-21kworker/u8:123:06:052
27728991613,2cyclictest3544-21kworker/u8:023:46:052
27728991613,2cyclictest29249-21kworker/u8:223:31:052
27728991613,2cyclictest25720-21kworker/u8:120:44:042
27728991613,2cyclictest23710-21kworker/u8:022:05:042
27728991613,2cyclictest23710-21kworker/u8:022:05:042
27728991613,2cyclictest23289-21kworker/u8:023:24:052
27728991613,2cyclictest19908-21kworker/u8:019:16:042
27728991613,2cyclictest19247-21kworker/u8:022:47:052
27728991613,2cyclictest19247-21kworker/u8:022:42:052
2772899161,13cyclictest0-21swapper/222:00:132
2772799161,3cyclictest0-21swapper/100:39:271
2772799160,14cyclictest0-21swapper/100:24:381
2772699161,13cyclictest11589-21apt-get19:50:060
2772999150,2cyclictest0-21swapper/320:43:333
2772999150,2cyclictest0-21swapper/319:18:013
2772899151,3cyclictest16205-21df20:00:132
27728991512,2cyclictest3042-21kworker/u8:220:50:042
27728991512,2cyclictest23395-21kworker/u8:220:23:052
27728991512,2cyclictest23289-21kworker/u8:023:29:052
27728991512,2cyclictest19247-21kworker/u8:022:53:052
27728991512,2cyclictest1617-21kworker/u8:121:47:052
27728991512,2cyclictest0-21swapper/200:02:192
2772899151,12cyclictest26962-21runrttasks21:27:572
2772899151,12cyclictest18630-21ssh22:35:472
27728991510,3cyclictest11592-21diskmemload22:20:132
2772899150,13cyclictest11592-21diskmemload22:28:392
2772799150,3cyclictest22830-21open_files20:15:191
2772799150,3cyclictest0-21swapper/123:43:541
2772799150,13cyclictest11592-21diskmemload23:20:141
2772799150,13cyclictest11592-21diskmemload00:32:481
2772799150,13cyclictest0-21swapper/123:10:051
2772799150,13cyclictest0-21swapper/122:43:581
2772799150,13cyclictest0-21swapper/121:58:511
2772699151,2cyclictest0-21swapper/019:20:160
27726991512,2cyclictest0-21swapper/000:18:470
27726991510,3cyclictest0-21swapper/000:13:030
2772699150,3cyclictest0-21swapper/023:47:270
2772699150,2cyclictest11592-21diskmemload23:41:370
2772699150,13cyclictest11592-21diskmemload22:05:570
2772699150,13cyclictest11592-21diskmemload22:05:570
2772699150,13cyclictest0-21swapper/022:45:370
2772999144,8cyclictest7458-21runrttasks20:34:373
2772999144,8cyclictest3323-21latency_hist19:30:003
2772999144,8cyclictest3323-21latency_hist19:30:003
2772999140,2cyclictest0-21swapper/320:06:583
27728991411,2cyclictest5684-21kworker/u8:220:08:042
27728991411,2cyclictest30592-21kworker/u8:222:12:052
27728991411,2cyclictest28391-21kworker/u8:221:56:052
27728991411,2cyclictest25720-21kworker/u8:120:25:052
27728991411,2cyclictest25187-21kworker/u8:223:02:052
27728991411,2cyclictest19908-21kworker/u8:019:45:042
27728991411,2cyclictest16123-21kworker/u8:221:17:032
2772899140,2cyclictest11592-21diskmemload23:36:472
2772899140,2cyclictest11592-21diskmemload22:33:092
2772899140,12cyclictest11592-21diskmemload22:57:572
2772899140,12cyclictest11592-21diskmemload00:35:392
2772899140,12cyclictest0-21swapper/200:10:242
2772799149,3cyclictest25086-21df_inode22:05:151
2772799149,3cyclictest25086-21df_inode22:05:151
27727991411,2cyclictest11592-21diskmemload22:30:261
27727991411,2cyclictest0-21swapper/121:40:201
27727991411,2cyclictest0-21swapper/121:20:241
27727991411,2cyclictest0-21swapper/120:25:181
27727991411,2cyclictest0-21swapper/100:05:401
2772799140,3cyclictest28862-21munin-node1
2772799140,3cyclictest14040-21forks23:50:141
2772799140,2cyclictest11592-21diskmemload23:19:421
2772799140,2cyclictest0-21swapper/123:01:081
2772799140,12cyclictest12374-21apt-get21:50:111
2772799140,12cyclictest0-21swapper/123:31:301
2772799140,12cyclictest0-21swapper/123:25:131
2772799140,12cyclictest0-21swapper/122:45:251
2772799140,12cyclictest0-21swapper/121:31:381
2772799140,12cyclictest0-21swapper/120:45:001
2772799140,12cyclictest0-21swapper/100:26:481
2772799140,12cyclictest0-21swapper/100:10:131
2772699141,9cyclictest10989-21ssh23:06:030
27726991411,2cyclictest11592-21diskmemload21:38:170
27726991411,2cyclictest0-21swapper/000:33:170
27726991411,2cyclictest0-21swapper/000:22:170
2772699140,2cyclictest0-21swapper/022:39:470
2772699140,13cyclictest0-21swapper/023:00:070
2772699140,13cyclictest0-21swapper/022:52:170
2772699140,12cyclictest2475-21ps19:25:180
2772699140,12cyclictest2475-21ps19:25:180
2772699140,12cyclictest22966-21ssh22:41:160
2772699140,12cyclictest11592-21diskmemload21:40:380
2772699140,12cyclictest11592-21diskmemload21:24:250
2772699140,12cyclictest0-21swapper/023:27:530
2772699140,12cyclictest0-21swapper/022:23:510
2772699140,12cyclictest0-21swapper/021:05:000
2772699140,12cyclictest0-21swapper/000:26:350
2772699140,12cyclictest0-21swapper/000:05:390
2772999133,8cyclictest4257-21expr19:30:153
2772999133,3cyclictest26063-21telnet20:25:123
2772899139,2cyclictest5609-21ssh23:40:132
2772899138,3cyclictest0-21swapper/219:55:252
27728991310,2cyclictest19908-21kworker/u8:019:38:042
27728991310,2cyclictest19908-21kworker/u8:019:22:042
27728991310,2cyclictest15893-21kworker/u8:020:31:052
27728991310,2cyclictest11972-21kworker/u8:119:52:042
27728991310,2cyclictest11592-21diskmemload23:56:482
27728991310,2cyclictest11592-21diskmemload23:56:482
27728991310,2cyclictest11592-21diskmemload21:20:072
27728991310,2cyclictest11592-21diskmemload00:26:082
27728991310,2cyclictest0-21swapper/223:50:202
27728991310,2cyclictest0-21swapper/223:10:502
27728991310,2cyclictest0-21swapper/221:51:492
27728991310,2cyclictest0-21swapper/221:14:492
2772899130,2cyclictest0-21swapper/200:09:382
2772899130,11cyclictest0-21swapper/223:15:382
2772799132,9cyclictest3021-21unixbench_singl00:15:271
2772799131,10cyclictest0-21swapper/119:30:131
27727991310,2cyclictest11592-21diskmemload00:00:031
27727991310,2cyclictest0-21swapper/123:55:461
27727991310,2cyclictest0-21swapper/123:55:461
27727991310,2cyclictest0-21swapper/123:06:521
27727991310,2cyclictest0-21swapper/122:00:211
27727991310,2cyclictest0-21swapper/121:26:211
27727991310,2cyclictest0-21swapper/121:10:301
27727991310,2cyclictest0-21swapper/119:35:111
2772799130,3cyclictest0-21swapper/123:35:241
2772799130,2cyclictest11592-21diskmemload23:48:011
2772799130,2cyclictest11592-21diskmemload22:16:441
2772799130,12cyclictest0-21swapper/122:57:211
2772799130,12cyclictest0-21swapper/122:20:181
2772799130,12cyclictest0-21swapper/121:16:021
2772799130,12cyclictest0-21swapper/121:00:271
2772799130,11cyclictest0-21swapper/121:35:351
2772799130,11cyclictest0-21swapper/120:50:191
2772699138,3cyclictest0-21swapper/021:05:250
2772699138,3cyclictest0-21swapper/019:15:140
2772699132,6cyclictest0-21swapper/020:45:000
2772699132,6cyclictest0-21swapper/020:40:010
27726991310,2cyclictest11592-21diskmemload23:31:440
27726991310,2cyclictest0-21swapper/023:35:490
27726991310,2cyclictest0-21swapper/023:11:270
27726991310,2cyclictest0-21swapper/022:26:120
27726991310,2cyclictest0-21swapper/021:46:120
27726991310,2cyclictest0-21swapper/021:12:460
2772699130,2cyclictest6855-21nscd00:00:200
2772699130,2cyclictest0-21swapper/022:33:050
2772699130,12cyclictest0-21swapper/023:53:170
2772699130,12cyclictest0-21swapper/021:53:320
2772699130,11cyclictest11592-21diskmemload21:30:320
2772699130,11cyclictest0-21swapper/023:20:540
33732120,2sleep03381-21ssh22:57:330
2772899122,7cyclictest0-21swapper/219:11:012
2772899120,11cyclictest0-21swapper/220:35:132
2772799129,2cyclictest11592-21diskmemload22:36:171
2772799127,3cyclictest0-21swapper/119:10:241
2772799121,3cyclictest0-21swapper/119:50:161
2772799120,2cyclictest13703-21copy19:55:041
2772799120,2cyclictest0-21swapper/122:50:401
2772799120,2cyclictest0-21swapper/119:40:161
2772799120,1cyclictest0-21swapper/120:20:131
2772799120,11cyclictest0-21swapper/122:10:081
2772799120,11cyclictest0-21swapper/119:25:231
2772799120,11cyclictest0-21swapper/119:25:231
2772699129,2cyclictest11592-21diskmemload00:35:330
2772699129,2cyclictest0-21swapper/022:01:490
2772699123,6cyclictest28250-21df19:10:130
2772699120,2cyclictest0-21swapper/021:55:310
2772699120,2cyclictest0-21swapper/020:50:220
2772699120,2cyclictest0-21swapper/019:55:130
2772899118,2cyclictest6179-21kworker/u8:120:56:042
2772799116,3cyclictest0-21swapper/120:35:121
2772799113,6cyclictest0-21swapper/119:45:111
2772799112,7cyclictest0-21swapper/120:01:581
2772799111,8cyclictest32722-21sort19:20:141
2772799111,8cyclictest0-21swapper/119:15:151
2772799110,9cyclictest5588-21munin-node1
2772799110,9cyclictest1561-21munin-node1
2772799110,9cyclictest0-21swapper/121:05:231
2772799110,9cyclictest0-21swapper/120:05:121
2772699118,2cyclictest0-21swapper/020:55:170
2772699113,6cyclictest0-21swapper/020:00:230
2772699112,6cyclictest0-21swapper/020:29:580
2772699111,5cyclictest0-21swapper/020:20:010
2772899107,2cyclictest19908-21kworker/u8:019:30:042
2772799107,2cyclictest0-21swapper/120:10:121
2772699107,2cyclictest0-21swapper/020:30:150
2772699104,3cyclictest24808-21head20:20:180
2772699102,6cyclictest0-21swapper/020:10:250
2772699100,9cyclictest0-21swapper/019:35:080
2772699100,8cyclictest0-21swapper/020:05:160
8465290,6sleep00-21swapper/019:40:160
277269994,3cyclictest6431-21nscd19:45:120
277269994,3cyclictest5421-21copy19:35:000
277269994,3cyclictest31846-21wc20:40:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional