You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-17 - 11:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6s.osadl.org (updated Wed Dec 17, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6478211798,13sleep30-21swapper/319:08:063
62962115104,6sleep10-21swapper/119:05:561
6262211489,19sleep00-21swapper/019:05:310
6614211089,16sleep20-21swapper/219:09:492
8982720,1sleep20-21swapper/200:32:132
33442700,0sleep30-21swapper/300:35:163
128192700,0sleep10-21swapper/122:13:441
137582530,2sleep1665799cyclictest22:15:081
665899320,1cyclictest0-21swapper/220:25:112
6658992619,2cyclictest0-21swapper/219:45:122
665699250,23cyclictest0-21swapper/021:10:040
665899240,22cyclictest0-21swapper/221:10:012
665899221,19cyclictest22899-21diskmemload22:10:112
665999211,18cyclictest0-21swapper/320:55:123
665799211,2cyclictest22899-21diskmemload23:30:121
665899200,18cyclictest0-21swapper/200:10:112
665799200,2cyclictest0-21swapper/120:25:111
665799200,2cyclictest0-21swapper/120:20:121
665699200,18cyclictest0-21swapper/000:10:110
665799190,18cyclictest0-21swapper/122:40:111
665799190,18cyclictest0-21swapper/120:55:121
6659991712,3cyclictest10954-21latency_hist20:40:003
223962170,1sleep20-21swapper/200:20:032
6659991611,3cyclictest0-21swapper/321:25:263
6658991613,2cyclictest9080-21kworker/u8:019:19:052
6658991613,2cyclictest19073-21kworker/u8:123:00:052
6658991613,2cyclictest1370-21kworker/u8:123:41:042
6657991613,2cyclictest9887-21kworker/u8:022:22:051
313462160,1sleep20-21swapper/221:19:532
6659991511,2cyclictest0-21swapper/322:30:143
665999150,2cyclictest0-21swapper/322:39:503
665999150,13cyclictest0-21swapper/323:24:093
665999150,13cyclictest0-21swapper/321:33:473
665899152,7cyclictest22899-21diskmemload00:40:002
665899152,7cyclictest0-21swapper/220:50:002
6658991512,2cyclictest902-21kworker/u8:220:31:042
6658991512,2cyclictest30999-21kworker/u8:021:26:072
6658991512,2cyclictest25489-21kworker/u8:223:17:052
6658991512,2cyclictest22045-21kworker/u8:219:58:052
665899150,3cyclictest25244-21sh22:28:142
6657991512,2cyclictest30729-21kworker/u8:122:52:051
665799150,13cyclictest28892-21copy21:55:041
665799150,13cyclictest22899-21diskmemload22:31:371
665799150,13cyclictest0-21swapper/123:37:471
665699150,13cyclictest22899-21diskmemload21:45:230
665999142,7cyclictest0-21swapper/323:00:003
6659991411,2cyclictest0-21swapper/322:45:403
6659991411,2cyclictest0-21swapper/321:15:103
6659991410,2cyclictest0-21swapper/322:15:003
665999140,3cyclictest1958-21ps22:00:183
665999140,2cyclictest0-21swapper/322:41:403
665999140,2cyclictest0-21swapper/300:30:313
665999140,12cyclictest22899-21diskmemload21:49:003
665999140,12cyclictest22466-21apt-get00:20:113
665999140,12cyclictest1869-21ssh21:22:273
665999140,12cyclictest0-21swapper/323:42:593
665999140,12cyclictest0-21swapper/323:11:233
665999140,12cyclictest0-21swapper/323:09:083
665999140,12cyclictest0-21swapper/322:51:433
665999140,12cyclictest0-21swapper/322:23:153
665999140,12cyclictest0-21swapper/322:18:583
665999140,12cyclictest0-21swapper/321:57:403
665999140,12cyclictest0-21swapper/320:00:123
665899142,7cyclictest20521-21ssh21:45:012
6658991411,2cyclictest9887-21kworker/u8:022:15:052
6658991411,2cyclictest29210-21kworker/u8:120:19:052
6658991411,2cyclictest29210-21kworker/u8:120:13:042
6658991411,2cyclictest18608-21kworker/u8:021:05:052
6658991410,2cyclictest22899-21diskmemload22:45:232
665899140,3cyclictest11643-21uniq22:50:142
665899140,12cyclictest22899-21diskmemload23:45:362
665899140,12cyclictest22899-21diskmemload23:14:032
665799149,3cyclictest780-21diskmemload22:37:241
665799149,3cyclictest0-21swapper/123:10:101
665799149,3cyclictest0-21swapper/122:57:541
665799141,2cyclictest22902-21apt-get21:10:071
665799141,2cyclictest22899-21diskmemload21:45:501
665799141,11cyclictest27768-21cut00:25:221
665799140,2cyclictest22899-21diskmemload21:22:091
665799140,13cyclictest0-21swapper/123:07:471
665799140,13cyclictest0-21swapper/121:05:171
665799140,13cyclictest0-21swapper/100:06:271
665799140,12cyclictest8248-21latency_hist23:25:001
665799140,12cyclictest22899-21diskmemload21:41:571
665799140,12cyclictest22899-21diskmemload21:32:521
665799140,12cyclictest22899-21diskmemload00:17:491
665799140,12cyclictest22899-21diskmemload00:00:271
665799140,12cyclictest0-21swapper/123:40:231
665799140,12cyclictest0-21swapper/120:30:121
665799140,12cyclictest0-21swapper/119:45:201
665799140,12cyclictest0-21swapper/119:20:251
6656991411,2cyclictest0-21swapper/023:50:230
6656991411,2cyclictest0-21swapper/023:35:530
6656991411,2cyclictest0-21swapper/023:09:030
665699140,12cyclictest22899-21diskmemload22:37:020
665699140,12cyclictest0-21swapper/023:26:230
665699140,12cyclictest0-21swapper/022:54:220
189732140,2sleep20-21swapper/200:15:152
665999138,3cyclictest0-21swapper/323:47:443
665999132,6cyclictest0-21swapper/319:20:003
665999132,10cyclictest0-21swapper/300:15:313
6659991310,2cyclictest0-21swapper/323:30:203
6659991310,2cyclictest0-21swapper/323:00:183
6659991310,2cyclictest0-21swapper/321:50:293
6659991310,2cyclictest0-21swapper/321:35:173
6659991310,2cyclictest0-21swapper/321:10:513
6659991310,2cyclictest0-21swapper/300:07:453
665999130,2cyclictest22899-21diskmemload23:25:283
665999130,2cyclictest0-21swapper/323:56:503
665999130,2cyclictest0-21swapper/323:38:193
665999130,2cyclictest0-21swapper/320:40:223
665999130,12cyclictest0-21swapper/323:19:283
665899132,6cyclictest0-21swapper/221:50:012
6658991310,2cyclictest9080-21kworker/u8:019:39:042
6658991310,2cyclictest22899-21diskmemload22:09:242
6658991310,2cyclictest17898-21kworker/u8:223:56:052
6658991310,2cyclictest1370-21kworker/u8:123:34:042
6658991310,2cyclictest13123-21kworker/u8:120:53:052
6658991310,2cyclictest0-21swapper/223:51:342
6658991310,2cyclictest0-21swapper/221:37:332
665899130,2cyclictest0-21swapper/222:33:522
665899130,2cyclictest0-21swapper/221:30:142
665899130,12cyclictest0-21swapper/219:50:152
665899130,11cyclictest22899-21diskmemload22:21:252
665799138,3cyclictest16884-21date20:55:001
6657991310,2cyclictest5382-21kworker/u8:222:46:051
6657991310,2cyclictest22899-21diskmemload21:50:431
6657991310,2cyclictest0-21swapper/123:59:261
6657991310,2cyclictest0-21swapper/123:45:071
6657991310,2cyclictest0-21swapper/121:38:391
6657991310,2cyclictest0-21swapper/121:28:391
6657991310,2cyclictest0-21swapper/120:10:001
6657991310,2cyclictest0-21swapper/100:22:461
6657991310,2cyclictest0-21swapper/100:10:101
665799130,2cyclictest0-21swapper/123:51:421
665799130,2cyclictest0-21swapper/122:25:091
665799130,1cyclictest0-21swapper/123:28:071
665799130,11cyclictest0-21swapper/119:35:221
665799130,11cyclictest0-21swapper/100:30:211
665699139,3cyclictest0-21swapper/023:20:040
665699131,7cyclictest13653-21ssh22:15:010
665699131,2cyclictest22899-21diskmemload23:40:250
6656991310,2cyclictest22899-21diskmemload22:44:110
6656991310,2cyclictest22899-21diskmemload00:35:020
6656991310,2cyclictest22899-21diskmemload00:20:250
6656991310,2cyclictest0-21swapper/021:33:330
6656991310,2cyclictest0-21swapper/000:30:150
665699130,2cyclictest0-21swapper/022:25:270
665699130,2cyclictest0-21swapper/022:20:110
665699130,2cyclictest0-21swapper/021:22:030
665699130,12cyclictest0-21swapper/000:07:230
665699130,11cyclictest22899-21diskmemload00:16:070
293362130,2sleep30-21swapper/300:27:393
281282130,2sleep00-21swapper/021:53:440
262342130,2sleep022899-21diskmemload23:45:180
171352130,10sleep00-21swapper/022:56:000
665999129,2cyclictest0-21swapper/319:55:173
665999127,3cyclictest1656-21awk20:15:193
665999123,5cyclictest0-21swapper/319:30:223
665999122,7cyclictest0-21swapper/319:38:593
665999120,2cyclictest0-21swapper/319:40:173
665999120,2cyclictest0-21swapper/300:01:383
665999120,11cyclictest0-21swapper/323:53:593
665999120,11cyclictest0-21swapper/322:27:493
665999120,11cyclictest0-21swapper/322:05:153
665999120,11cyclictest0-21swapper/321:40:093
665999120,11cyclictest0-21swapper/320:30:203
665999120,11cyclictest0-21swapper/300:10:493
665899129,2cyclictest9080-21kworker/u8:019:42:052
665899129,2cyclictest22899-21diskmemload00:01:232
665899129,2cyclictest12524-21kworker/u8:219:33:052
665899129,2cyclictest12524-21kworker/u8:219:24:052
665899129,2cyclictest0-21swapper/223:22:532
665899129,2cyclictest0-21swapper/223:05:552
665899129,2cyclictest0-21swapper/222:55:232
665899129,2cyclictest0-21swapper/221:57:432
665899129,2cyclictest0-21swapper/221:21:062
665899122,7cyclictest0-21swapper/219:13:592
665899121,7cyclictest9843-21ssh00:05:112
665899120,2cyclictest0-21swapper/222:00:322
665899120,2cyclictest0-21swapper/221:45:252
665899120,2cyclictest0-21swapper/220:55:152
665899120,1cyclictest0-21swapper/222:40:142
665899120,11cyclictest0-21swapper/223:35:442
665899120,11cyclictest0-21swapper/223:26:142
665899120,11cyclictest0-21swapper/220:40:242
665899120,11cyclictest0-21swapper/220:20:242
665899120,10cyclictest0-21swapper/200:25:112
665799129,2cyclictest0-21swapper/123:17:341
665799129,2cyclictest0-21swapper/123:00:191
665799129,2cyclictest0-21swapper/122:05:301
665799129,2cyclictest0-21swapper/120:45:221
665799129,2cyclictest0-21swapper/120:00:121
665799127,3cyclictest6675-21snmpd19:40:191
665799121,8cyclictest7184-21cpuspeed_turbos19:10:131
665799120,2cyclictest0-21swapper/119:55:221
665799120,2cyclictest0-21swapper/100:36:381
665799120,11cyclictest0-21swapper/122:01:211
665799120,11cyclictest0-21swapper/121:16:111
665799120,11cyclictest0-21swapper/120:10:201
665699129,2cyclictest31522-21ssh21:57:040
665699129,2cyclictest22899-21diskmemload23:12:580
665699129,2cyclictest0-21swapper/023:03:310
665699129,2cyclictest0-21swapper/022:47:500
665699129,2cyclictest0-21swapper/022:05:240
665699129,2cyclictest0-21swapper/022:03:480
665699129,2cyclictest0-21swapper/021:37:020
665699129,2cyclictest0-21swapper/000:27:190
665699122,7cyclictest0-21swapper/000:02:020
665699122,6cyclictest6675-21snmpd19:55:220
665699120,2cyclictest0-21swapper/023:31:190
665699120,2cyclictest0-21swapper/023:18:060
665699120,11cyclictest3506-21ssh21:25:110
665699120,11cyclictest0-21swapper/023:56:420
665699120,11cyclictest0-21swapper/021:40:250
665699120,11cyclictest0-21swapper/021:00:210
665699120,11cyclictest0-21swapper/020:30:010
192312120,2sleep10-21swapper/121:00:141
665999118,2cyclictest0-21swapper/319:50:233
665999118,2cyclictest0-21swapper/319:46:093
665999115,4cyclictest537-21cron20:15:003
665999112,6cyclictest0-21swapper/320:06:593
665899118,2cyclictest9080-21kworker/u8:020:08:052
665899118,2cyclictest22899-21diskmemload22:35:452
665899118,2cyclictest12524-21kworker/u8:219:25:042
665899116,3cyclictest28053-21tail20:00:152
665799118,2cyclictest0-21swapper/120:40:181
665799111,8cyclictest0-21swapper/120:15:251
665799110,9cyclictest13051-21munin-node1
665799110,2cyclictest0-21swapper/119:15:181
665799110,10cyclictest0-21swapper/120:35:191
665699118,2cyclictest22899-21diskmemload22:15:150
665699116,3cyclictest0-21swapper/019:50:130
665699112,5cyclictest0-21swapper/020:15:000
665699111,7cyclictest7497-21gdm-simple-gree20:45:590
665699111,6cyclictest0-21swapper/019:20:000
665699110,2cyclictest0-21swapper/022:32:590
665699110,2cyclictest0-21swapper/021:16:420
199852110,2sleep20-21swapper/221:00:192
152292110,1sleep30-21swapper/320:50:143
665999107,2cyclictest0-21swapper/320:25:263
665999105,3cyclictest21588-21grep21:05:133
665999102,7cyclictest0-21swapper/319:12:593
665999100,9cyclictest0-21swapper/319:20:273
665899100,7cyclictest0-21swapper/220:35:592
665799100,8cyclictest23511-21df_abs19:50:141
665699107,2cyclictest0-21swapper/021:05:130
665699105,3cyclictest27331-21telnet20:00:110
665699105,3cyclictest1020-21tr20:15:140
665699102,6cyclictest0-21swapper/020:35:300
665699101,5cyclictest0-21swapper/020:30:000
665699100,7cyclictest0-21swapper/019:46:590
665699100,7cyclictest0-21swapper/019:28:590
66599996,2cyclictest0-21swapper/320:45:143
66599994,3cyclictest3963-21switchtime20:20:253
66599994,3cyclictest19584-21sort21:00:153
66599990,2cyclictest0-21swapper/319:25:013
66579991,6cyclictest0-21swapper/119:30:171
66569994,3cyclictest7224-21grep19:10:130
66569994,3cyclictest19250irq/25-ahci[00020:55:130
66569992,6cyclictest0-21swapper/020:50:240
66569992,6cyclictest0-21swapper/019:40:190
66569992,5cyclictest0-21swapper/020:09:020
66569991,6cyclictest0-21swapper/020:20:240
66569991,6cyclictest0-21swapper/019:35:180
66569991,6cyclictest0-21swapper/019:15:230
66569990,2cyclictest0-21swapper/020:40:200
66569983,3cyclictest15050-21taskset19:30:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional