You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 06:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot4s.osadl.org (updated Tue Jun 23, 2026 00:45:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
199999633,7cyclictest131rcu_preempt20:30:132
198299618,42cyclictest13143-21ssh22:35:130
199999563,32cyclictest0-21swapper/223:05:132
199099544,45cyclictest6275-21ssh21:20:121
199099541,49cyclictest16930-21ssh22:55:131
199099538,7cyclictest131rcu_preempt19:45:121
1990995210,8cyclictest21-21ksoftirqd/121:15:131
198299523,40cyclictest29566-21ssh21:15:140
199099513,41cyclictest24894-21ssh23:35:141
199999503,32cyclictest11837-21ssh23:10:132
199999501,26cyclictest31271-21sh22:45:142
199999483,30cyclictest0-21swapper/221:50:132
1999994513,28cyclictest27-21ksoftirqd/223:23:232
199099454,35cyclictest7806-21ssh22:50:121
199099451,35cyclictest4070-21ssh22:30:131
198299442,33cyclictest3902-21ssh00:35:150
200899422,27cyclictest35966irq/58-eth021:25:123
200899422,24cyclictest35966irq/58-eth023:50:123
198299422,29cyclictest20080-21diskmemload23:45:140
200899413,25cyclictest35966irq/58-eth021:45:113
200899404,24cyclictest35966irq/58-eth021:30:123
200899403,21cyclictest35966irq/58-eth022:35:123
1990994013,17cyclictest21-21ksoftirqd/123:05:131
198299402,32cyclictest31263-21ssh22:45:140
200899393,23cyclictest35966irq/58-eth023:05:123
1999993814,10cyclictest131rcu_preempt23:55:112
199099371,11cyclictest15551-21kthreadcore00:05:201
198299378,19cyclictest12-21ksoftirqd/020:35:120
198299378,19cyclictest12-21ksoftirqd/020:35:110
200899365,21cyclictest35966irq/58-eth022:50:133
200899363,24cyclictest35966irq/58-eth000:30:133
200899363,20cyclictest35966irq/58-eth022:15:133
199099361,24cyclictest32514-21ssh00:15:141
200899352,16cyclictest35966irq/58-eth021:20:123
199099355,20cyclictest1563-21ssh23:40:131
200899343,18cyclictest35966irq/58-eth020:20:113
199999343,20cyclictest27-21ksoftirqd/223:45:122
199999342,9cyclictest0-21swapper/222:35:142
199099345,8cyclictest27879-21sh22:25:161
199099341,12cyclictest19225-21switchtime21:25:281
200899333,19cyclictest35966irq/58-eth023:35:133
200899332,15cyclictest35966irq/58-eth000:35:133
200899331,18cyclictest35966irq/58-eth023:30:143
200899331,18cyclictest35966irq/58-eth023:30:133
199999333,18cyclictest27346irq/40-dwc2_hso00:15:132
199999330,15cyclictest19241-21ssh21:45:092
199099331,10cyclictest9873-21sed20:25:181
2008993220,8cyclictest35966irq/58-eth022:25:113
199999325,10cyclictest27-21ksoftirqd/219:10:132
199999324,10cyclictest131rcu_preempt23:00:132
199099328,6cyclictest4394-21memory20:50:211
199099323,21cyclictest23506-21ssh00:10:131
199099322,23cyclictest14209-21ssh22:00:141
1990993214,11cyclictest1978-21cyclictest23:00:151
199099321,12cyclictest14290-21netstat23:45:231
199099321,11cyclictest32103-21ntp_states21:50:271
199099321,11cyclictest19277-21/usr/sbin/munin23:30:241
199099321,11cyclictest19277-21/usr/sbin/munin23:30:231
198299323,21cyclictest9179-21ssh00:20:120
1982993210,18cyclictest12-21ksoftirqd/020:25:130
199999316,15cyclictest27346irq/40-dwc2_hso20:40:122
199099313,10cyclictest13926-21kthreadcore19:55:191
199099312,10cyclictest8523-21kthreadcore23:25:191
199099311,11cyclictest23527-21uname23:50:281
199099311,10cyclictest12926-21kthreadcore21:00:201
199099310,11cyclictest2951-21ssh22:10:241
199999303,16cyclictest27346irq/40-dwc2_hso19:45:132
199999301,21cyclictest0-21swapper/200:05:122
199099309,3cyclictest0-21swapper/100:00:131
199099309,3cyclictest0-21swapper/100:00:121
199099304,15cyclictest19232-21ssh21:45:101
199099302,21cyclictest30041-21ssh23:20:141
199099302,10cyclictest26332-21grep22:40:291
1990993012,3cyclictest20080-21diskmemload23:10:311
199099301,20cyclictest0-21swapper/120:20:121
199999293,16cyclictest27346irq/40-dwc2_hso19:25:112
199999292,8cyclictest131rcu_preempt00:30:142
199999292,7cyclictest131rcu_preempt23:28:232
199999292,20cyclictest0-21swapper/219:40:132
199099291,3cyclictest131rcu_preempt21:35:011
199099291,11cyclictest31922-21kthreadcore19:40:181
199099291,10cyclictest22012-21proc_pri22:20:271
199999282,20cyclictest9053-21ssh22:15:142
199999282,15cyclictest27346irq/40-dwc2_hso19:15:112
1999992812,10cyclictest27-21ksoftirqd/221:30:142
199099282,2cyclictest0-21swapper/100:20:121
199099281,21cyclictest20482-21ssh21:10:131
198299281,19cyclictest28872-21ssh23:55:140
2008992711,9cyclictest35966irq/58-eth021:15:123
199999272,19cyclictest0-21swapper/219:50:142
199099274,17cyclictest20953-21ssh23:15:131
199099271,10cyclictest10914-21irqstats21:40:171
198299274,14cyclictest12-21ksoftirqd/023:10:130
198299272,19cyclictest4919-21ssh23:23:240
200899262,17cyclictest35966irq/58-eth021:55:123
1999992617,6cyclictest12679-21ssh00:20:232
199999261,17cyclictest15346-21ssh21:25:122
199099262,19cyclictest9043-21ssh22:15:131
198299262,19cyclictest14842-21ssh23:29:220
1982992611,7cyclictest0-21swapper/000:07:500
200899253,12cyclictest0-21swapper/321:10:143
2008992519,4cyclictest35966irq/58-eth022:05:143
199999259,11cyclictest0-21swapper/222:55:142
199999256,13cyclictest27346irq/40-dwc2_hso21:15:132
199999254,11cyclictest27-21ksoftirqd/220:45:122
199999253,12cyclictest27346irq/40-dwc2_hso20:15:112
199999252,8cyclictest23041-21ssh23:33:232
199999252,8cyclictest23041-21ssh23:33:222
199999252,16cyclictest0-21swapper/221:05:152
198299253,3cyclictest131rcu_preempt22:00:020
1982992513,8cyclictest12-21ksoftirqd/021:50:120
199999249,6cyclictest22893-21cron22:05:022
199999242,15cyclictest261rcuc/223:15:132
199999242,15cyclictest0-21swapper/220:35:042
199999242,15cyclictest0-21swapper/220:35:042
198299248,7cyclictest12-21ksoftirqd/022:17:330
1982992412,9cyclictest5655-21cron20:55:020
1982992412,9cyclictest23310-21sh22:05:150
198299241,18cyclictest20502-21ssh21:10:140
1982992411,7cyclictest0-21swapper/021:40:580
200899233,13cyclictest0-21swapper/322:20:053
200899232,14cyclictest35966irq/58-eth019:10:123
200899232,14cyclictest0-21swapper/322:10:153
199999238,12cyclictest17537-21sh20:00:002
199999232,6cyclictest0-21swapper/222:20:132
199999231,3cyclictest131rcu_preempt22:53:082
199999231,18cyclictest12551-21basename00:40:012
1982992312,3cyclictest0-21swapper/020:05:250
200899224,14cyclictest35966irq/58-eth000:25:133
2008992212,5cyclictest0-21swapper/321:40:113
199999229,11cyclictest0-21swapper/222:41:382
199999228,11cyclictest1336-21latency_hist23:40:012
199999226,10cyclictest10215-21ssh21:40:122
199999223,13cyclictest27346irq/40-dwc2_hso21:00:132
199099221,12cyclictest9635-21cat20:55:291
198299229,4cyclictest151rcuc/019:45:130
198299229,4cyclictest12-21ksoftirqd/022:50:220
198299227,10cyclictest12-21ksoftirqd/023:40:130
198299226,12cyclictest19739-21ssh23:50:120
198299225,4cyclictest131rcu_preempt21:20:020
198299223,12cyclictest12-21ksoftirqd/000:17:160
198299222,15cyclictest12-21ksoftirqd/020:40:120
1982992216,4cyclictest0-21swapper/000:30:240
1982992215,5cyclictest0-21swapper/022:10:020
1982992214,5cyclictest0-21swapper/022:55:060
1982992212,7cyclictest18222-21ssh22:20:130
200899219,9cyclictest0-21swapper/300:02:093
200899219,9cyclictest0-21swapper/300:02:083
200899218,9cyclictest0-21swapper/323:20:303
200899213,12cyclictest0-21swapper/323:29:223
199999217,6cyclictest27-21ksoftirqd/200:10:232
199999216,12cyclictest10663-21sshd21:56:232
199999213,9cyclictest28110-21kthreadcore19:35:212
199999213,9cyclictest28110-21kthreadcore19:35:202
199999213,15cyclictest19922-21kthreadcore00:25:202
199999212,16cyclictest17966-21fschecks_time20:00:172
199999212,10cyclictest27505-21fschecks_count20:10:172
199999211,9cyclictest131rcu_preempt23:40:172
1999992114,5cyclictest0-21swapper/200:00:432
1999992114,5cyclictest0-21swapper/200:00:422
199999211,3cyclictest131rcu_preempt22:05:192
199999211,10cyclictest8599-21usage_EthcTask22:30:312
1999992110,9cyclictest973-21ssh21:35:032
199999210,5cyclictest9249-21ls20:25:022
199999210,12cyclictest2621466ssh23:52:262
199099213,12cyclictest0-21swapper/119:50:121
199099211,16cyclictest1144-21sh21:35:141
198299217,5cyclictest12-21ksoftirqd/023:19:280
198299217,4cyclictest131rcu_preempt23:02:510
198299216,7cyclictest12-21ksoftirqd/000:00:380
198299216,7cyclictest12-21ksoftirqd/000:00:370
198299215,5cyclictest131rcu_preempt21:45:210
198299214,3cyclictest131rcu_preempt20:30:120
1982992114,4cyclictest0-21swapper/000:25:130
198299211,3cyclictest131rcu_preempt19:10:020
1982992111,4cyclictest12-21ksoftirqd/020:20:250
200899203,12cyclictest0-21swapper/322:40:143
200899203,11cyclictest0-21swapper/322:00:133
2008992013,4cyclictest0-21swapper/300:20:153
2008992011,6cyclictest0-21swapper/323:00:223
199999203,11cyclictest0-21swapper/219:30:132
199999202,10cyclictest13919-21cron20:30:002
1999992011,7cyclictest0-21swapper/222:26:132
199999201,15cyclictest22774-21grep20:05:162
199999201,13cyclictest32357-21ssh22:10:142
199999201,11cyclictest24139-21ntpq21:10:272
199999201,10cyclictest7444-21kthreadcore20:55:192
199099209,8cyclictest23291-21apt-get22:05:131
199099202,11cyclictest3875-21ssh00:35:121
1990992013,4cyclictest15137-21kthreadcore22:35:211
1990992012,6cyclictest11494-21sshd19:15:571
199099201,16cyclictest9452-21cat21:55:291
198299209,5cyclictest131rcu_preempt22:43:500
198299209,5cyclictest131rcu_preempt21:33:390
198299208,3cyclictest131rcu_preempt00:11:040
198299206,4cyclictest12-21ksoftirqd/023:05:360
198299205,3cyclictest131rcu_preempt19:20:220
198299201,7cyclictest30750-21awk19:40:000
198299201,7cyclictest30750-21awk19:40:000
1982992014,4cyclictest0-21swapper/022:30:500
1982992013,5cyclictest12-21ksoftirqd/020:45:160
1982992012,5cyclictest0-21swapper/019:50:180
198299201,12cyclictest4322-21latency_hist20:20:010
198299200,15cyclictest1358-21cut21:35:170
200899197,9cyclictest0-21swapper/323:55:143
200899191,12cyclictest35966irq/58-eth000:10:133
200899191,12cyclictest0-21swapper/322:30:153
2008991910,4cyclictest0-21swapper/323:10:213
199999199,7cyclictest0-21swapper/220:50:242
199999191,10cyclictest6904-21irqrtprio21:20:182
199999191,10cyclictest12104-21grep19:20:172
199099199,5cyclictest30831-21kthreadcore23:55:201
199099196,10cyclictest25210-21grep19:30:271
199099193,13cyclictest18235-21ssh00:25:121
199099191,13cyclictest18759-21apt-get20:35:041
199099191,13cyclictest18759-21apt-get20:35:031
198299199,2cyclictest131rcu_preempt21:00:180
198299199,2cyclictest12-21ksoftirqd/019:15:260
198299198,8cyclictest31957-21cron20:15:020
198299196,4cyclictest12-21ksoftirqd/022:01:110
198299195,10cyclictest131rcu_preempt23:35:020
1982991914,3cyclictest0-21swapper/021:25:260
1982991913,4cyclictest0-21swapper/023:30:160
1982991913,4cyclictest0-21swapper/023:30:150
1982991913,4cyclictest0-21swapper/019:55:140
198299191,12cyclictest27302-21ssh22:25:100
200899189,7cyclictest0-21swapper/300:15:033
200899186,9cyclictest0-21swapper/321:35:183
200899182,10cyclictest0-21swapper/321:05:163
200899182,10cyclictest0-21swapper/320:10:143
200899182,10cyclictest0-21swapper/319:25:133
200899182,10cyclictest0-21swapper/319:20:123
2008991810,6cyclictest0-21swapper/321:50:203
2008991810,5cyclictest35966irq/58-eth022:55:133
199099189,6cyclictest4786-21kthreadcore19:10:211
199099186,10cyclictest0-21swapper/119:35:211
199099186,10cyclictest0-21swapper/119:35:201
199099185,10cyclictest31417-21head00:30:311
199099185,10cyclictest17036-21kthreadcore21:05:221
199099181,14cyclictest3963-21usage_EthcTask20:15:291
199099181,13cyclictest31389-21diskstats22:45:151
198299182,5cyclictest12-21ksoftirqd/019:25:270
198299182,4cyclictest12-21ksoftirqd/020:00:160
198299181,6cyclictest25948-21munin-plugin-st19:35:010
1982991812,4cyclictest0-21swapper/021:05:330
200899173,9cyclictest0-21swapper/323:40:143
200899172,9cyclictest35966irq/58-eth022:45:123
200899172,12cyclictest0-21swapper/323:45:143
200899172,10cyclictest0-21swapper/319:50:143
200899171,12cyclictest0-21swapper/300:05:203
2008991710,4cyclictest0-21swapper/323:18:573
199999171,13cyclictest2019-21cat19:10:012
199099173,11cyclictest29522-21kthreadcore20:10:211
199099173,11cyclictest13483-21kthreadcore19:20:181
199099172,3cyclictest131rcu_preempt20:30:151
199099172,12cyclictest20178-21grep19:25:261
1990991711,4cyclictest17897-21grep20:00:161
199099171,13cyclictest29825-21kthreadcore20:45:201
199099171,13cyclictest26031-21kthreadcore20:40:191
198299178,2cyclictest131rcu_preempt20:55:230
198299175,10cyclictest2769-21cut19:10:180
198299173,7cyclictest131rcu_preempt19:40:120
200899162,9cyclictest0-21swapper/321:00:133
200899162,10cyclictest0-21swapper/319:15:133
200899161,12cyclictest0-21swapper/319:50:013
200899161,10cyclictest0-21swapper/319:55:193
199099161,12cyclictest23793-21kthreadcore20:05:201
200899159,3cyclictest0-21swapper/319:40:273
200899149,3cyclictest0-21swapper/320:55:263
200899149,3cyclictest0-21swapper/320:18:463
200899149,3cyclictest0-21swapper/319:38:323
200899149,3cyclictest0-21swapper/319:38:313
200899148,4cyclictest0-21swapper/320:50:133
200899141,6cyclictest0-21swapper/320:00:143
200899141,10cyclictest0-21swapper/320:40:213
200899141,10cyclictest0-21swapper/320:35:023
199099141,10cyclictest2017-21latency_hist19:10:011
200899138,3cyclictest0-21swapper/319:30:143
200899131,5cyclictest0-21swapper/320:25:273
200899131,10cyclictest0-21swapper/320:50:023
200899122,6cyclictest0-21swapper/320:40:013
200899122,6cyclictest0-21swapper/320:40:003
200899121,8cyclictest0-21swapper/319:10:023
200899111,7cyclictest0-21swapper/320:05:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional