You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-28 - 06:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat Mar 28, 2026 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1491430994531,10cyclictest311ktimers/221:30:132
1491422994518,24cyclictest1508356-21/usr/sbin/munin19:55:240
1491425994417,23cyclictest0-21swapper/122:45:251
149142599441,10cyclictest1527878-21cron20:54:011
1491422994437,4cyclictest1527962-21cron20:55:000
1491422994436,4cyclictest1526275-21latency_hist20:50:000
1491433994233,5cyclictest1570829-21sendmail23:00:003
1491425994235,4cyclictest1533543-21fschecks_time21:10:171
1491425994215,24cyclictest0-21swapper/121:45:331
1491430994131,6cyclictest1601455-21grep00:25:252
149142599412,6cyclictest1600019-21cron00:25:001
149142599411,8cyclictest1542179-21diskstats21:35:141
1491425994117,21cyclictest0-21swapper/100:30:241
149142599411,12cyclictest1589368-21grep23:50:271
1491422994112,12cyclictest1536971-21grep21:20:140
149143099403,7cyclictest32-21ksoftirqd/219:55:142
1491430994033,4cyclictest1557171-21audit_send_reply22:20:002
149142599408,2cyclictest0-21swapper/121:23:191
1491425994029,7cyclictest1565282-21grep22:40:221
149142599401,9cyclictest1571239-21cut23:00:151
1491425994019,16cyclictest0-21swapper/120:00:261
149142599401,8cyclictest1499537-21grep19:30:221
149142599401,8cyclictest1499537-21grep19:30:221
1491425994013,24cyclictest1551554-21cat22:00:251
1491425994010,4cyclictest0-21swapper/123:15:251
149142599400,10cyclictest1569338-21apt-get22:55:151
1491422994029,6cyclictest0-21swapper/000:25:000
1491422994013,11cyclictest645-21runrttasks19:42:590
1491433993930,6cyclictest1517291-21unixbench_multi20:20:253
1491433993930,6cyclictest1517291-21unixbench_multi20:20:253
1491433993929,6cyclictest0-21swapper/323:20:003
1491433993926,8cyclictest1493306-21munin-node19:15:013
1491430993930,5cyclictest0-21swapper/200:25:002
149142599396,7cyclictest1493970-21cat19:15:151
149142599392,5cyclictest1507511-21munin-run19:55:001
149142599392,12cyclictest1605337-21apt00:39:591
149142599391,8cyclictest1525675-21/usr/sbin/munin20:45:261
149142599391,8cyclictest1507950-21fschecks_time19:55:171
149142599391,7cyclictest1495761-21cut19:20:171
1491425993914,21cyclictest0-21swapper/122:35:151
1491425993913,22cyclictest0-21swapper/120:45:021
1491425993911,25cyclictest0-21swapper/122:05:171
149142599391,10cyclictest1528646-21meminfo20:55:181
1491422993928,7cyclictest1572535-21cut23:05:010
1491422993912,9cyclictest1592634-21timerandwakeup00:00:250
1491433993828,6cyclictest1522859-21sh20:40:023
1491425993830,5cyclictest1587624-21unixbench_multi23:45:251
149142599382,9cyclictest1573319-21ntp_states23:05:211
149142599382,8cyclictest1500698-21runrttasks19:35:131
149142599382,7cyclictest1522410-21grep20:35:251
149142599382,6cyclictest1579738-21cut23:25:141
149142599382,5cyclictest1557416-21/usr/sbin/munin22:20:171
149142599381,9cyclictest1582743-21cron23:35:001
149142599381,9cyclictest1559689-21ntp_states22:25:211
149142599381,9cyclictest1549888-21grep21:55:241
149142599381,9cyclictest1547750-21ntp_states21:50:231
149142599381,9cyclictest1540902-21/usr/sbin/munin21:30:211
149142599381,9cyclictest1512331-21sshd20:06:371
149142599381,8cyclictest1595619-21grep00:10:181
149142599381,8cyclictest1592360-21grep00:00:231
149142599381,7cyclictest1521137-21cron20:35:001
149142599381,7cyclictest1513888-21sed20:10:251
149142599381,6cyclictest1503415-21tail19:40:251
149142599381,10cyclictest1555811-21df_inode22:15:131
1491422993822,11cyclictest1575660-21cron23:12:000
1491422993816,18cyclictest1544299-21ntpq21:40:180
1491422993813,19cyclictest0-21swapper/020:05:120
1491433993726,8cyclictest391ktimers/300:35:133
1491430993729,5cyclictest1513867-21unixbench_multi20:10:252
149142599378,4cyclictest1518466-21missed_timers20:25:231
149142599378,3cyclictest0-21swapper/100:27:381
149142599372,7cyclictest1562277-21cron22:35:011
149142599372,7cyclictest1562277-21cron22:35:001
149142599371,9cyclictest1593983-21grep00:05:211
149142599371,9cyclictest1574617-21sort23:10:161
149142599371,9cyclictest1530099-21tune2fs21:00:161
149142599371,7cyclictest438-21cron21:10:001
149142599371,11cyclictest1585913-21tail23:40:231
149142599371,10cyclictest1539199-21/usr/sbin/munin21:25:221
149142299379,25cyclictest1495530-21latency_hist19:20:010
1491422993727,7cyclictest1603445-21sshd00:32:520
1491422993724,9cyclictest1546498-21sed21:45:360
1491422993724,7cyclictest0-21swapper/022:55:260
1491422993716,13cyclictest0-21swapper/022:00:120
1491422993712,21cyclictest1523030-21cat20:40:010
1491433993626,6cyclictest1530959-21grep21:00:263
1491433993625,8cyclictest391ktimers/300:25:133
149142599364,5cyclictest1579356-21munin-plugin-st23:25:011
149142599362,5cyclictest1555009-21grep22:10:281
149142599361,9cyclictest1597811-21grep00:15:241
149142599361,9cyclictest1535585-21tr21:15:301
149142599361,8cyclictest438-21cron23:40:001
149142599361,8cyclictest1568668-21head22:50:261
149142599361,5cyclictest1498760-21cron19:30:001
1491425993612,21cyclictest645-21runrttasks19:45:051
149142599361,11cyclictest1516039-21idleruntime-cro20:20:001
149142599361,10cyclictest1590989-21/usr/sbin/munin23:55:241
1491422993629,4cyclictest1605359-21sendmail00:39:590
1491422993623,10cyclictest1559124-21/usr/sbin/munin22:25:120
1491422993621,11cyclictest0-21swapper/023:30:140
1491422993617,14cyclictest0-21swapper/020:40:110
1491422993613,18cyclictest1511078-21latency_hist20:05:010
1491433993527,3cyclictest0-21swapper/320:55:153
1491433993525,6cyclictest1603634-21sh00:34:593
1491430993526,4cyclictest0-21swapper/222:47:062
1491422993523,8cyclictest1491572-21/usr/sbin/munin19:10:110
1491422993522,10cyclictest1538971-21/usr/sbin/munin21:25:190
1491422993521,11cyclictest1562631-21/usr/sbin/munin22:35:130
1491422993520,10cyclictest1556260-21ntp_states22:15:200
1491422993519,9cyclictest0-21swapper/019:35:130
1491422993519,12cyclictest1507083-21unixbench_singl19:50:260
1491433993425,5cyclictest1527961-21cron20:55:003
1491433993425,4cyclictest0-21swapper/323:55:253
1491433993424,6cyclictest1513894-21grep20:10:253
1491433993423,7cyclictest0-21swapper/321:55:163
1491433993423,7cyclictest0-21swapper/321:45:363
1491430993426,4cyclictest0-21swapper/223:55:242
1491430993426,4cyclictest0-21swapper/221:15:152
1491430993425,5cyclictest0-21swapper/222:42:042
149142599341,7cyclictest1492573-21unixbench_multi19:10:241
1491422993426,5cyclictest1536085-21unixbench_singl21:15:340
1491422993424,7cyclictest1534609-21sshd21:12:520
1491422993423,8cyclictest1578440-21ntp_states23:20:200
1491422993421,9cyclictest0-21swapper/021:00:140
1491422993421,10cyclictest1572755-21apt23:05:130
1491422993420,11cyclictest1597442-21/usr/sbin/munin00:15:200
1491433993322,7cyclictest0-21swapper/322:15:233
1491430993326,4cyclictest0-21swapper/223:45:152
1491430993325,4cyclictest0-21swapper/219:15:262
1491430993323,6cyclictest1539482-21grep21:25:242
149142599331,7cyclictest1544769-21grep21:40:231
149142299339,8cyclictest1519910-21perl20:30:150
1491422993327,3cyclictest1549325-21meminfo21:55:180
1491422993325,4cyclictest0-21swapper/020:55:260
1491422993322,8cyclictest1600525-21/usr/sbin/munin00:25:150
1491422993322,8cyclictest1547811-21/usr/sbin/munin21:50:240
1491422993322,8cyclictest1543425-21sshd21:38:520
1491422993320,10cyclictest1590336-21/usr/sbin/munin23:55:170
1491422993317,11cyclictest1517279-21unixbench_multi20:20:250
1491422993317,11cyclictest1517279-21unixbench_multi20:20:250
1491422993315,14cyclictest1515601-21sed20:15:240
1491422993314,15cyclictest1497191-21latency_hist19:25:020
1491422993311,18cyclictest1593577-21sort00:05:160
1491433993225,3cyclictest0-21swapper/320:30:273
1491430993225,4cyclictest0-21swapper/200:05:272
1491430993224,4cyclictest0-21swapper/200:10:242
1491430993222,6cyclictest0-21swapper/220:55:262
1491422993223,4cyclictest0-21swapper/023:50:160
1491422993222,7cyclictest1595578-21/usr/sbin/munin00:10:160
1491422993222,7cyclictest1580876-21cron23:28:000
1491422993222,7cyclictest1565519-21sshd22:42:520
1491422993222,7cyclictest1504715-21/usr/sbin/munin19:45:220
1491422993221,8cyclictest1519263-21sshd20:27:520
1491422993221,7cyclictest1587184-21ntp_states23:45:210
1491422993221,7cyclictest1513176-21/usr/sbin/munin20:10:180
1491422993217,12cyclictest1552597-21if_eth022:05:170
1491422993215,12cyclictest1555050-21unixbench_singl22:10:270
1491422993211,8cyclictest1560928-21df22:30:140
1491422993211,8cyclictest1560928-21df22:30:140
1491433993122,6cyclictest1594477-21unixbench_singl00:05:263
1491433993122,4cyclictest0-21swapper/323:45:253
1491433993120,6cyclictest0-21swapper/320:01:363
1491430993125,4cyclictest1514171-21kworker/u8:0+events_unbound20:24:422
1491430993125,4cyclictest1514171-21kworker/u8:0+events_unbound20:24:412
1491430993124,4cyclictest0-21swapper/223:00:252
1491430993124,4cyclictest0-21swapper/221:10:282
1491430993121,6cyclictest0-21swapper/219:45:252
1491430993119,7cyclictest0-21swapper/220:01:362
1491422993121,7cyclictest1585539-21/usr/sbin/munin23:40:210
1491422993121,7cyclictest1583785-21/usr/sbin/munin23:35:220
1491422993121,7cyclictest1557425-21/usr/sbin/munin22:20:130
1491422993121,7cyclictest1497641-21/usr/sbin/munin19:25:180
1491422993120,7cyclictest1499121-21diskstats19:30:170
1491422993120,7cyclictest1499121-21diskstats19:30:170
1491433993020,6cyclictest0-21swapper/323:10:263
1491433993019,6cyclictest0-21swapper/319:30:273
1491433993019,6cyclictest0-21swapper/319:30:273
1491430993023,4cyclictest0-21swapper/221:40:012
1491430993023,3cyclictest0-21swapper/221:05:252
1491430993022,5cyclictest311ktimers/220:30:122
1491430993022,4cyclictest0-21swapper/223:00:002
1491430993015,12cyclictest311ktimers/222:10:132
1491422993021,7cyclictest1531618-21/usr/sbin/munin21:05:100
1491422993020,7cyclictest1567690-21/usr/sbin/munin22:50:140
1491422993020,7cyclictest1540416-21/usr/sbin/munin21:30:150
1491422993019,7cyclictest1566054-21diskstats22:45:140
1491422993014,12cyclictest1576152-21munin-node23:15:110
1491433992921,4cyclictest0-21swapper/320:15:253
1491433992920,5cyclictest0-21swapper/319:20:233
149143099291,5cyclictest131rcu_preempt23:50:132
1491433992820,5cyclictest1552067-21kthreadd22:05:003
1491433992819,4cyclictest0-21swapper/322:35:243
1491433992817,7cyclictest0-21swapper/321:30:003
1491430992821,4cyclictest0-21swapper/222:20:252
1491430992820,4cyclictest0-21swapper/220:35:252
1491430992820,4cyclictest0-21swapper/200:30:252
149143399272,21cyclictest1540574-21fschecks_time21:30:183
1491433992719,4cyclictest0-21swapper/321:05:253
1491433992717,6cyclictest0-21swapper/319:55:263
1491430992721,4cyclictest1524345-21kworker/u8:1+events_unbound21:56:412
1491430992720,4cyclictest0-21swapper/222:30:252
1491430992720,4cyclictest0-21swapper/222:30:252
1491433992617,6cyclictest1504749-21grep19:45:233
1491430992619,4cyclictest1563992-21sh22:40:002
1491430992619,4cyclictest0-21swapper/221:20:242
1491430992618,4cyclictest0-21swapper/219:35:022
1491430992618,4cyclictest0-21swapper/219:35:012
1491430992617,6cyclictest1592288-21kworker/u8:2+events_unbound00:00:222
1491430992617,5cyclictest0-21swapper/222:50:262
1491430992616,6cyclictest0-21swapper/220:45:272
1491433992517,4cyclictest0-21swapper/321:15:343
1491433992517,3cyclictest0-21swapper/322:45:253
149143399251,3cyclictest0-21swapper/320:49:203
1491430992521,2cyclictest0-21swapper/220:40:112
1491430992519,4cyclictest0-21swapper/219:50:162
1491430992517,5cyclictest0-21swapper/223:20:152
1491430992516,5cyclictest1515565-21grep20:15:242
149143399246,7cyclictest131rcu_preempt19:19:023
1491433992418,3cyclictest0-21swapper/319:40:003
1491433992415,6cyclictest1558879-21cron22:25:013
1491433992415,6cyclictest1543913-21grep21:40:133
1491433992414,6cyclictest1518858-21cat20:25:263
149143099246,6cyclictest131rcu_preempt19:40:132
1491430992418,3cyclictest0-21swapper/222:00:272
1491430992417,5cyclictest1572311-21kworker/u8:3+events_unbound23:40:192
149143099241,3cyclictest1529921-21apt-get21:00:132
1491433992317,3cyclictest0-21swapper/321:25:003
1491433992316,5cyclictest1568990-21kworker/u8:0+events_unbound23:07:103
1491433992315,5cyclictest391ktimers/320:45:013
1491433992315,5cyclictest0-21swapper/323:40:233
1491433992313,6cyclictest391ktimers/321:15:013
1491430992317,4cyclictest1512468-21kworker/u8:3+events_unbound20:26:412
1491430992317,3cyclictest0-21swapper/219:20:252
1491430992316,4cyclictest1574225-21idleruntime-cro23:10:002
1491430992315,5cyclictest1598333-21tr00:20:002
1491430992314,5cyclictest1552500-21tune2fs22:05:162
149143099231,12cyclictest0-21swapper/219:35:122
149143099230,12cyclictest0-21swapper/221:45:342
1491433992216,3cyclictest0-21swapper/323:20:233
1491433992215,4cyclictest391ktimers/323:05:013
1491433992215,4cyclictest1485865-21kworker/u8:3-ext4-rsv-conversion19:30:013
1491433992212,7cyclictest0-21swapper/321:50:253
1491430992216,4cyclictest1544460-21sendmail_mailqu21:40:222
1491430992216,3cyclictest0-21swapper/223:15:232
1491430992215,5cyclictest1500261-21kworker/u8:1+events_unbound20:09:552
1491430992214,6cyclictest1582564-21kworker/u8:1+events_unbound23:38:232
1491430992212,6cyclictest0-21swapper/200:35:212
149143099220,5cyclictest131rcu_preempt21:50:122
149143399219,8cyclictest1543534-21cron21:40:013
1491433992114,4cyclictest1597027-21fschecks_time00:15:143
1491433992114,3cyclictest0-21swapper/319:45:013
1491433992113,4cyclictest0-21swapper/323:35:263
1491433992111,6cyclictest0-21swapper/300:25:003
149143399210,9cyclictest0-21swapper/322:30:483
149143399210,9cyclictest0-21swapper/322:30:483
1491430992115,4cyclictest1579051-21kworker/u8:0+events_unbound23:32:492
1491430992114,5cyclictest311ktimers/222:25:152
1491430992110,7cyclictest1493039-21cron19:15:002
1491433992014,4cyclictest15060202sleep319:50:063
1491433992014,3cyclictest1579806-21fschecks_time23:25:143
1491433992013,5cyclictest391ktimers/300:10:093
1491433992012,5cyclictest0-21swapper/323:50:163
1491433992012,5cyclictest0-21swapper/320:05:253
1491430992013,5cyclictest311ktimers/219:25:122
1491430992013,4cyclictest311ktimers/220:50:142
1491433991912,3cyclictest0-21swapper/322:10:273
1491430991911,4cyclictest311ktimers/223:10:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional